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ABSTRACT 

This paper presents the results of a series of 
summary analyses of descriptive statistics concerning 5,720 Louisiana 
teachers who were assessed with the System for Teaching and Learning 
Assessment and Review (STAR)-- a comprehensive on-the-job statewide 
teacher assessment system — during the second pilot year (1989-90). 
Data were collected by about 3,000 principals, master teachers, and 
other Louisiana educators in STAR assessor certification programs 
during fall 1989 and spring 1990 professional development sessions. 
The 1989-90 STAR is ULed to: (1) assess the quality of teaching and 
learning on sets of assessment indicators (AIs) that define 21 
teaching and learning components (TLCs) ; and (2) train principals 
master teachers, supervisors ^ college faculty, and other educators to 
complete thorough assessments of beginning and experienced teachers' 
classroom performances for the purpose of renewable professional 
certification (RFC). The STAR is organized into four performance 
dimensions defined by subelements/TLCs, with a total of 140 AIs. Data 
were summarize^ by computing frequencies of acceptable and 
unacceptable decisions for each of the STAR TLCs, as well as the 
individual AIs within each component. The results are presented as 
summaries for AIs by each STAR TLC: for elementary and secondary 
education, for beginning and experienced teachers, within cognitive 
group, within performance group, and ue^ween cognitive and 
performance groups. Summary comparisons between 1989 (first pilot 
year) and 1989-90 (second pilot y^ar) STAR TLCs are included. 
Appendix A presents five data tables. Appendix B outlines the 
organizational structure of the 1989 STAR. (RLC) 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. 



ERIC 



Classroom Asscssmcnls of 6000 Teachers: 

What do the Results Show About the 
Effectiveness of Teaching and Learning? 



U.S. DEPARTMENT OF EDUCATION 

OHice of Educ«lional Research and Improvement 

EDUCATIONAL RESOURCES INFORMATION 
CENTER lERlC) 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



document has been reproduced as 
received Ifom Ihe person or oroaniialion 
originating il 
r Minor chunges have been made to improve 
reproduction quality 

• Points ol view or optnions Stated m thiS docu 
meni do nol necessarily r^preseni olliciai 
OERi position or policy 



ff-6 'iJiLL 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



Flo H. Hill 
Louisiana State University 

Joseph G. Claudet 
Louisiana State University 



Karen S. Loup 
Louisiana Slate University 

Sheila W. Cliauvin 
Louisiana Stale University 

and 



Nitin S. Nailt 
Louisiana State University 



Paper presented to the ^IG/Qassroom Observation 
at the meeting of the 
American Educational Research Association 
Chicago, IL 
April, \m 



I BEST COPY AVAILABLE 

ERJC 9 



TABLE OF CONTENTS 



Overview 1 

Purpose 2 

Metliods and Procedures 3 

Sample 3 

Instrumentation/Observation Process 3 

Data Collection 5 

Data Analyses 5 

Results 6 

Summaries for STAR Teaching and Learning Components 6 

Summaries ^or Assessment Indicators By Each STAR Component for Elementary 

and Secondary 7 

Summaries for Assessment Indicators By Each STAR Component for Beginning 

and Experienced Teachers 15 

Summary Analysis for Assessment Indicators By Each STAR Component "Within" 
Cognitive Group (Subject Areas: Language, Math, Science, and Social 

Sciences) 24 

Summary Analysis for Assessment Indicators By Each STAR Component "Within" 
Performance Group (Subject Areas: Art, Band, Elective Courses, and 

Physical Education) 32 

Summary Analysis For Assessment Indicators By Each STAR Component 

"Between" Cognitive and Performance Groups 40 

Summary Comparisons Between 1989 (First Pilot Year) and 1989-90 (Second Pi)ot 

Year) STAR Teaching and Learning Components 47 

Discussion, Implications and Conclusions 48 

References 54 

Appendices 55 



ERIC 



3 



1 



Classroom Assessments of 6000 Teachers: What Do the Results Show 
About the Effectiveness of Teaching and Learning? 

Overview 

The System for Teaching and learning Assessment and Review (STAR) (Ellett, Loup & 
Chauvin, 1989-90) is a comprehensive, on-tne-job teacher assessment system designed to collect 
information and make important decisions about the quality of effective teacliing and student 
learning in classrooms within an interactive framework of professional development and support. 
The Louisiana STAR is being developed and piloted in response to two specific legislative 
mandates: 1) the Teaching Internship Law (1984); and 2) the Children First Act (1988). These two 
legislative acts, considered collectively, call for the development and implementation of a statewide 
teacher assessment/evaluation system for the purpose of induction of beginning teachers into the 
proftssion and the periodic evaluation of all Louisiana teachers for the purpose of renewable 
certification. 

The Teaching Internship law requires that all beginning teachers in Louisiana be assessed 
by a tliree-member support team consisting of the school principal, '\ "master'* teacher, preferably 
within the school, and currently, a college faculty member. The basic purpose of tlie internship 
program, as described by law, is to provide a profession* 1 support network for new teachers during 
their early year(s) of employment. Following successful completion of this first "intern" year 
(which may be extended to a second year, if needed), the new teacher then enters the regular 
periodic cycle of experienced teacher evaluations for renewable certification. 

Requirements contained in tlie Children First Act (1988) stipulate that all Louisiana teachers 
undergo periodic (five year) classroom evaluations based on a standvudized process/system for the 
purposes of renewable state certification. Additionally, the Children First Act contains a provision 
for the revision of the state teacher salary schedule, and a plan for a Model Career Options 
Program (MCOP) for teachers. Under tliis latter plan, teachers who receive a "superior" rating 
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under the new evaluation system will qualify for consideration in the MCOP. 

Reflecting a continuation of efforts begun initially during the Spring of 1989 (first STAR 
pilot year), tlie STAR assessment process/system was further developed and refined during FY 
1989-90 (second pilot year) through a program of seven-day professional assessor certification 
sessions conducted statewide (1989-90), in.volving approximately 6000 Louisiana educators. Thus, 
the further refinement/piloting of tlie STAR system during second year R«feD activides represents 
ongoing development of a "state-of-the-art" assessment/evaluation system to fulfill legislative 
mandates set forth in both the Teaching Internship Law (1984) and the Children First Act (i988). 

The second pilot year of research and development of the STAR occurred during FY 1989- 
90. The observational data examined in this study was collected during the 1989-90 school year, 
and they represent a statewide continuation of initial efforts begun during tlie Spring of 1989 (fu-st 
STAR pilot year) to collect actual performance data with the STAR in Louisian.a classrooms. 
These data were collected by STAR assessor trainees (principals, n aster teachers and other 
Louisiana educators) as part of participant requu-ements for successful completion of the STAR 
professional development program for certify assessors. This study reports the results of a series of 
summaij analyses of descriptive statistics on a large sample of Louisiana teachers (N=5720) 
assessed with the STAR during this second pilot year (1989-90). 

Purpose 

The purpose of tliis study is to provide descriptive summaries of STAR second pilot year 
assessment data collected in all parishes in Louisiana by participants (principals, master teachers 
and other Louisiana educators) in STAR assessor certification programs during the Fall, 1989 and 
Spring, 1990 professional development sessions. This series of data analyses were completed as a 
continuing examination of various levels of teacher classroom performance relative to tlie STAR 
assessment indicators, teaching and learning components and performance dimensions. 
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Methods and Procedures 

Sampk 

The sample for this study consisted of 5720 teachers representing classrooms from every 
parisii in Louisiana, lliese teachers were randomly selected from alphabetical faculty listings 
provided by educators participating in the STAR assessor certification program during tlie second 
pilot year (1989-90). This large sampling of Louisiana teachers encompasses a wide variety of 
both subject areas and teaching and learning contexts, and thus reflects tlie kinds of assessment 
situations in which teachers will be observed/assessed for the purposes of induction and renewable 
certification. 

Instrumentation/Observation Process 

The System for leaching and learning Assessment and Review (STAR) (Ellett, Loup & 
Chauvin, 1989-90) was used to collect all data for the analyses. The 1989-90 STAR (second pilot 
year edition) consists of four Performance Dimensions: 1) Preparation, Planning and Evaluation; 2) 
Classroom/Behavior Management; 3) Learning Environment; and 4) Enhancement of Learning. 
These four Performance Dimensions are defined by a scries of Teacliing and Learning Components, 
each of which are furtlicr opcrationalized by sets of assessment indicators. These assessment 
indicators constitute the fundamental ur.its of STAR process observation and decision making. The 
total number of assessment indicators comprising the 1989-90 STAR (second pilot year edition) 
was 140. The organizational structure of the 1989-90 STAR is illustrated in APPENDIX B. 

Performance Dimension I of the STAR (Preparation, Planning and Evaluation) is designed 
to allow the assessor to make pre-observation decisions relative to the teacher's ability to 
effectively prepare a Comprehensive Unit Plan (CUP) for a five- to seven-day unit of teaching and 
learning for one class of students of the teacher's choice. Multiple copies of the CUP are prepared 
by tlie teacher and submitted to each member of the assessment team for independent review. 
Teachers in this study were not required to prepare CUPs, and tliey were only assessed on 
Performance Dimensions II (Classroom/Behavior Maiiagement), III (Learning Environment) and IV 
(Enhancement of Learning). In order for assessors to have adequate knowledge of lesson 
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content/contexts for the classroom observations/assessments in this study, teachers did provide daily 
a lesson plan prior to each observation. 

An important element of the STAR observation/assessment process is the emphasis placed 
on the assessment of \2slh the teaching and learning taking place in tlie classroom. To this end, 
STAR assessors are trained to assume observation positions so as to maintain a clear view of not 
only the teacher, but most importantly, all of students. During an observation the r-^sessor 
functions as an observer of teacher and student actions/behaviors/responses and a data collector 
("notetaker"). In addition to documenting important teacher/student interactions, various physical 
classroom and learning environment conditions/events are recorded as well. Following the 
observation, the assessor compiles and synthesizes the observation notes and uses the STAR 
assessment document and Annotated Assessment Guide to make final assessment decisions on each 
assessment indicator. Before arriving at an assessment decision of either "acceptable" or 
"unacceptable" on each STAR indicator, the STAR assessor follows a systematic assessment 
decision-making process: 1) scanning the content of the indicator, 2) reviewing all pertment 
classroom context and observational data contained in tlie notes, and 3) considering/comparing 
various examples and considerations contained in tlie Annotation and decision-making rule for the 
mdicator. In following this procedure for each of the assessment indicators comprising the STAR, 
the assessor ensures that assessment decisions reflect as much as possible the holistic classroom 
environment and teachuig/leaming context. An example of the assessment indicators, annotations 
and decision-makng rules for the STAR Teaching and Learning Component of TIME is provided 
in APPENDIX B. 

As a "holistic" assessment system reflecting the quality of both teacher 
planning/performance and student learning, the STAI^ represents a "state-of-tlie-art" 
teachuig/leaming assessment framework tliat incorporates, and at the same time moves beyond, the 
strengtlis of prior assessmeiit systems developed in other states. Tlie content of the STAR 
assessment system reflects tlie current research on effective teaching and learning. A detailed 
description of the conceptual and research basis of the STAR can be found in a companion 
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research document (Claudet & EUett, 1989, Claudet & Ellelt, 1990) and will not be discussed here. 
As the second pilot year of research and development on the STAR is completed, further results 
from continued studies of the STAR (second pilot year) are providing furtlier support for the 
validity and reliability of the STAR as an on-tlie-job teacher assessment system/process. 
Data Collection 

The STAR pilot assessment process makes provision for tlie assessment of teachers for 
internship and certification purposes by a three-member team. After examining and assessing the 
CUP, each member of the team arranges a subsequent classroom observation of teaciring and 
learning with the teacher for a full lesson period (minimum of tliirty mii'.utes). These classroom 
observations take place during tlie unit prescribed by tlie CUP, and serve as opportunities for 
assessors to observe Uie teacher carry our the teaching/learning plans in the classroom. In the 
analyses reported here, no CUPs were assessed and onlv single observations of lessons occurred . 
The data for this study were collected by some 3000 trained STAR assessors as part of field 
observations associated with certification requirements for the second pilot year as a STAR 
assessor. For llie sample of 5720 completed and useable teacher assessments comprising tiiis 
summary analysis, each teacher was assessed only once, and each STAR assessor was required to 
complete two assessments. 
Pata Analyses 

Data from the 1989-90 (Second Pilot Year) STAR assessments were summarized by 
computing frequencies of "acceptable" and "unacceptable" decisions for each of the STAR 
components, as well as tlie individual assessment indicators witliin each component. Frequencies 
were computed for llie total sample of teachers (n=5720), and a "between-groups" compaiison was 
made of elementary (K-6) and secondary (7-12), and of begLnning and experienced teacher groups 
(Claudet, Hill, Eliett & Niiik, 1990). Additional analyses of acceptable/unacceptable decision 
frequencies were also completed tlirough a breakdown of tlic total sample (n=:5720) into two 
further sub-groups - "cognitive-oriented" vs. "performance-oriented" classrooms (Claudet, Hill 
Eliett & Naik, 1990). lliese analyses were completed as part of a continuing examination (begun 
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in the Spring of 1989 - First PUot Year) of performance data coUected from Louisiana's 
classrooms, and to compare assessment results from tliis data both within and across a variety of 
subgroups and teacliing/leaming contexts. As part of the analyses, percentages of Uie maximum 
possible ("mas-ery") scores were also computed for each STAR Teaching and Learning Component 

(n, ni & IV). 

Results 

.S^fmmaries for i<)TAP ^Parhinp ,^nH l.?-ffminp Components 

A summary of the percentage of maximum possible scores for each STAR Teaching and 
Learning Component is shown in Table 1. Tlie results of acceptable decisions made by STAR 
assessors for the total number of assessment indicators comprising each Teaching and Learning 
Component summed over 5720 assessments completed are indicated through a percentage of the 
maximum possible. For example, the Teaching and Learning Component of TIME in Dimension 
II, (Classroom and Behavior Management) with 8 assessment indicators times 5720 assessments 
yields a maximum number of 45,760 aissessment decisions. For the component TIME, tlie last 
column indicates that 72.39% of aU assessment decisions were assessed as acceptable. 

The percentage of acceptable and unacceptable assessment decisicns for each indicator for each 
Teaching and Learning Component within each STAR Performance Dimension was computed for 
the total sample (n) of classrooms and for elementary and secondary classroom settings. As 
shown, the percemage of maximum possible scores for the STAR Performance Dimension U 
(Classroom and Behavior Management) components ranged from a high of 74.17% (Classroom 
Routines) to a low of 36.87% (Student Engagement). Tlie results for student engagement shown 
represent the percentage of classrooms that were assessed as maintaining mean student engagement 
in learning task rates at or above 90%. For the total sample, less tlian half of the 5720 mean 
engagement rate estimates were below tlie 90% target standard and slightly less Uian half (48.48%) 
were viewed as acceptable in the component of Managing Task-Related Behavior. 

For STAR Performance Dimension 111 (Learning Environment), tlie results shown in Table 1 
indicate a higher percentage of acceptable assessment decisions for Uie Physical Learning 
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Environment (88.03%) than for tlie Psychosocial Learning Environment (66.40%). 

Considerable variation is shown in STAR Performance Dimension IV (Enhancement of 
Learning). The percentage for acceptable scores for components ranged from a high of 94.70% for 
Oral and Written Communication to a low of 21.56% for the indicators in Thlnidng Skills Less 
than half of the indicator assessment decisions were acceptable for Lesson and Activities Initiation 
(34.45%), Content Accuracy and Emphasis (49.14%), Thinking Skills (21.56%), Moniroring 
Learning Tasks and Informal Assessment (43.15%), and Feedback (33.22%). 

Summaries for Assessment Indicators By Each STAR Component for Elementary and Secondary 

Classroom and Behavior Management : Table 2 presents a summary of acceptable and 
unacceptable assessment decision percentages for tlie total sample (n) of classrooms and also by 
elementary (E) and secondary (S) classrooms for each assessment indicator for each STAR 
Teaching and Learning Component for Performance Dimension II (Classroom and Behavior 
Management). 

TIME: Efficient management and use of time is the focus of this STAR Teacliing and 
Learning Component. Percentages of acceptable assessment decisions for indicators for the total 
sample ranged from a high of 92.9% (Minor interruptions are managed quickly and efficiently or 
there are no interruptions) to a low of 21.4% (Expectations for maintaining and completing 
timelines for tasks are communicated to students). Similarities for elementary (E) and secondary 
(S) claiisrooms were noted for percentages of unacceptable decisions. The largest differences were 
evident for indicators number 1 (Learning activities begin promptly) and number 8 (Learning 
activities continue until tlie end of tlie allocated time period) with the unacceptable percentages 
being consistently higher for tlie secondary classrooms. 

CLASSROOM ROUTINES: The focus of this STAR Teaching and Learning Component 
in on tlie efficient and effective management of classroom routines necessary for student 
enhancement of learning. As shown in ble 2, the total number of classroom percentages for 
acceptable decisions for assessment indicators ranged from a high of J8.1% (Aids, materials and 
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equipment are available aiid ready to use) and to a low of 56.9 (Tlie attention of students is 
ensured before directions for routines are given or students are attending). The results for the E 
and S groups were similar. However, tlie elementary classrooms consistently scored slightly higher 
than the secondary classrooms in each indicator. 

STUDENT ENGAGEMENT: Tlie percentage for student engagement represents the 
percentage of assessments that generated overall classroom engagement in learning tasks rates at or 
above 90%. For the 5720 classrooms observed, less than half (36.7%) of the mean engagement 
estimates were below the targeted standard. The difference in tlie percentage of unacceptable 
decisions foi elementary and secondary settings was approximately 3% favoring tlic elementary 
group. 

MANAGING TASK-RELATED BEHAVIOR: The focus of this STAR Teaching and 
Learning Component is on monitoring and managing students* task-related behavior. The 
percentage of acceptable assessment decisions ranged from 43.3% (Efforts to redirect students who 
arc persistently off task are successful or there is no persistent off-task behavior) to 53.7% (Verbal 
and/or non-verbal techniques are used to redirect students who are persistently off-task or there us 
no persistent off-task behavior). Slightly more to less than half of all indicator assessment 
decisions were acceptable. The difference in tlie percentage of unacceptable decisions for 
elementary and secondary groups was approximately 5%, with larger percentages of unacceptable 
assessment decisions for tlic secondary group. 

MONITORING AND MAINTAINING STUDENT BEHAVIOR: This STAR Teaching and 
Learning Component focuses on tlie concern for effective management of acceptable and 
unacceptable student behavior. Percentages of acceptable assessment decisions for tlie total sample 
of classrooms ranged from a high of 66,6% (Uses techniques to stop unacceptable behavior or none 
arc needed or therc is no unacceptable behavior) to a low of 35% (Students are provided verbal 
and/or non-verbal feedback about acceptable and unacceptable behavior). Percentages of 
unacceptable decisions reflect similarities for tlie elementary and secondary groups. 
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Learning Environment : Table 3 presents summary data of acceptable and unacceptable 
decisions for assessment indicators from STAR Performance Dimension III, Lesming Environment. 
Results are highlighted for the two Teaching and Learning Components. 

PSYCHOSOCIAL: Assessment indicatoi"s in this STAR Teaching and Learning Component 
focus on the quality of tlie classroom climate and positive interpersonal relationships betwe^sn the 
teachei and students and among students. The percentage of acceptable assessment decisions 
ranged from a high of 86.6% (Warmth and friendliness are demonstrated throughout tlie lesson) to 
a low of 37.8% (Enthusiasm for teaching, learning and tlie subject being taught is communicated to 
students). Percentages of unacceptable decisions were similar for the elementary and secondary 
groups, with the exception of indicator number 5 (Comments, questions, examples and/or other 
contributions are sought from students tliroughout the lesson) (E=47%; S=50,5%). Approximately 
7% more unacceptable assessment decisions were made for the secondary groups. High 
percentages of acceptable assessment decisions for indicators number 1 (Establishcjs a classroom 
climate of courtesy and respect) (N=85%) and number 2 (Warmth and friendliness are 
demonstrated throughout tlie lesson) (N=86.6%) and rather low percentages of acceptable 
assessment decisions for indicators number 4 (Enthusiasm for teaching, learning and the subject 
being taught is communicated to students) (N=37.8%) and number 10 (The lesson in personalized 
for students) (39%) should be noted. 

PHYSICAL: Tlie focus of this STAR Teacliing and Learning Component reflects a 
concern for tlie elements of a physical learning envkonmcnt that enhances the learning of all 
students. The acceptable assessment decisions for this component were rather high as compared to 
previous components reviewed. The acceptable decisions ranged from a liigh of 94.2% (The 
classroom is neat, safe and arranged in an orderly manner) to a low of 76.6% (Display(s) create a 
pleasant atmosphere and serve a thematic/content-related purpose). Results indicate Uie greatest 
difference between tlie percentages of unacceptable assessment decisions for indicator number 2 
(Display(s) create a pleasant atmosphere and serve a thematic/content-related purpose) (E=19.4%; 
S=27%). 
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Enhancement of learning : Table 4 presents a summary of acceptable and unacceptable 
decision percentages for the total sample of classroom observations aiid also by elementary and 
secondary classroom groups for each assessment indicator operationalizing each Teaching and 
Learning Component in STAR Performance Dimension IV, Enhancement of Learning. 

LESSON AND ACTIVITIES INITIATION: This STAR Teaching and Uaming 
Component is composed of a set of ten assessment indicators tliat focus on the beginning of the 
lesson and on the beginning of various teaching and learning activities as they arise during a 
lesson. For this set of assessment indicators the percentages of acceptable decisions ranged from a 
high of 61.1% (Proct jural directions necessary to unplement learning tasks are clear and complete) 
to a low of 13.9% (Cleaily communicates the challenge of leaming task(s) to students as needed). 
The percentages of acceptable decisions for the assessment indicators in this component were 
substantially lower than tlie percentages for tlie other components noted above. Of the ten 
indicators described, only thice had percentages of acceptable decisions for the total classroom 
sample that were above 50% - and these only marginally so: 53.5% (Student attention is en/i^-ed 
before directions and explanations for learning activities are provide **or** students are attending), 
61.1% (Procedural directions necessary to implement learning tasks are clear and complete), and 
51.9% (Encourages all students to participate). Overall, the percentages of unacceptable decisions 
were considerably higher for these indicators than for those in Dimensions Two and Three akeady 
described. Tnere also was a strong consistency in the pattern of percentages of acceptable and 
unacceptable decisions among the elementary and secondary groups. Of the high percentages of 
unacceptable decisions obtained for this set of assessment indicators, six indicators received 
particularly high unacceptable percentages: number 2 (Activities are initiated with motivating 
introductions which are content related) (E=71.5%; S=77.1%), number 3 (Clearly communicates 
specific learning outcomes to students) (E=71.1%; S=72.7%), number 4 (The purpose and 
importance of learning activities are communicated to students) (E=83.1%; S=79,8%), number 5 
(Expectations about student engagement in learning tasks are communicated at tlie beginning of 
activities) (E=73.8%; S=74.0%), number 7 (Clearly communicates the challenge of learning task(s) 
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to students as needed) (E=86.4%; S=85.9), and number 10 (As new ideas/concepts/activities are 
introduced, they are related to past and future learning) (E=80.5%; E= 77.0%). 

TEACHING METHODS: This STAR Teaching and Learning Component addresses tlie 
teacher's ability to utilize teachiiig methods that facilitate the acliievement of planned learning 
objectives and encourage student interaction and active involvement in learning tasks. For the total 
sample of classrooms (N) reviewed, the percentages of acceptable decisions ranged from a high o< 
87.1% (Teaching metliods and learning tasks or topics within an activity are sequenced in a logical 
order) to a low of 25.2% (Provision is made for lesson/activities closure). There was a close 
consistency between the elementary and secondary group percentages in thisj component with rather 
large percentages of unacceptable decisions occurring for indicator numbers 3-5 (witliin the range 
of 37.0 - 52.2%). Significantly high percentages of unacceptable decisions were obtained for both 
elementary and secondary groups for indicator number 6 (Provision is made for lesson/activities 
closure) (E=73.4%; S=76.0%). 

AIDS AND MATERIALS: This STAR Teaching and Learning Component reflects 
assessment concerns regarding the teacher's ability to use planned aids ("tilings teachers use to 
show or work with the class to enhance students' learning") and materials ("things that students use 
to enhance their learning") during the lesson in a manner that enliances students' learning. 
Percentages of acceptable decisions for tiie total sample of classrooms (n) were rather closely 
grouped within a range of a high of 72.5% (Ihe use of teaching aids is appropriate for methods 
and objectives; and Teaching aids are used at appropriate times in tlie lesson) to a low of 47.8% 
(Learning materials are used properly and accommodate the range of needs and abihties of 
students). Of the eight indicators comprising this component, differences between the E and S 
groups in the percentages of unacceptable decisions were ratlier negligible with the exception of 
indicators number 5 (The use of learning materials is appropriate for learning tasks and objectives) 
(E=27.0; S=32.5%) and number 7 (Learning materials are used at appropriate times in tlie lesson 
(&=26.9%; S=32.45). Additionally, rather modest percentages of acceptable decisions (within the 
range of 62.8% to 72 5%) were obtained for the majority of the assessment indicators in tliis 
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component with the exception of three indicators: number 4 (Tlie use of teaching aids broadens 
understandings and enhances learning) (E=51.6%; S=49.2%), number 6 (Learning materials are 
used properly and accommodate the range of needs and abilities of students) (E=46.8%; S=48.6%), 
and number 8 (Use of learning materials broadens student understandings and enhances learning) 
(E=49.0%; S=47.2%). 

CONTENT ACCURACY AND EMPHASIS: The set of seven assessment indicators 
comprising tliis Teacliing and Learning Component focuses on the teacher's adequate command of 
subject knowledge, the teacher's abihty to differentiate lesson content cit more tlian one cognitive 
level and to emphasize structural frameworks for learning material as well as important elements 
within these. Results for the total sample of classrooms (n) indicate a considerable range of 
percentages of acceptable decisions across indicatois. These percentages ranged from a high of 
93.5% (Content knowledge is accurate and up-to-date) to a low of 19.2% (Emphasizes the value 
and importance of topics and activities). Differences between the percentages of unacceptable 
decisions for the E and S groups were negligible in most instances. Of particular interest are tlie 
rather high percentages of unacceptable decisions for four assessment indicators in this component: 
number 1 (Smdents are given opportunities to learn at more tlian one cognitive and/or performance 
level) (E=67.9%; S=68.0%), number 2 (Emphasizes the value and importance of topics and 
activities) (E=83.1%; S=78.7%), number 6 (Essential elements of content knowledge and/or 
performance tasks are emphasized) (E=72.7%; 70.0%), and number 7 (Potential areas or points of 
difficuUy are emphasized throughout the lesson) (E=73.6%; 73.9%). 

THINKING SKILLS: The set of eleven indicators in this Teaching and Learning 
Component centers around assessment considerations of the teacher's ability to actively involve 
students throughout the lesson in the development o; higher order thinking. These indicators are 
concemed with both the "what" (content) and tlie "how" (teaching methods and learning tasks) of 
thinking. Key concepts embedded in this important STAR component are the teacher's ability to 
actively involve students in learmng, and to provide students with ample opportunities to develop 
concepts and skills in generating, structuring, Uansferring and restructuring knowledge. 
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The overaU results indicated a far larger percentage of unacceptable decisions for this 
Teaching and Leaniing Component than for ail of Uie Components in Dimensions Two and Three, 
as weU as being considerably lower than Uie percentages for the other Components in Dimension 
Four. For the total sample of 5720 classrooms (n). the percentages of unacceptable decisions 
ranged from a high of 86.1% (Encourages students to use mental imagery) to a low of 61.8% 
(Wait time is used to enhance student learning). AU of the percentages of unacceptable decisions 
for these eleven indicators witliout exception were significantly high (above 70.0%). There was a 
close consistency between elementary and secondary groups in percentages of unacceptable 
decisions per indicator, with noticeable exceptions occurring for only two indicators: number 2 
(Involves students in developing concepts) (E=70.7%; S=76.8%). and number 7 (Wait time is used 
to enhance student learning) (E=57.8%; S=65.4%). 

CLARIFICATION: Tiiis STAR Teaching and Learning Component focuses attention on 
the teacher's ability to identify and clarify areas of misunderstanding and confusion as teaching and 
learning proceed. The results for the five assessment indicators operationalizing this Compontnt in 
terms of the total sample of classrooms (n) indicated a rather narrow range of percentages of 
acceptable decisions from a high of 63.7% (Clarifications are made for individuals or small groups 
rather than for the entire class ♦♦or** this type of clarification is not necessary) to a low of 44.2% 
(Areas of misunderstanding or difficulty arc identified before students ask questions **or** no 
misunderstanding or difficulty occurs). There was a close consistency between elementary and 
secondary groups across the five indicators with regard to percentages of unacceptable decisions. 
As the percentages of unacceptable decisions were in the moderately high range for the majority of 
these indicators (ranging from 36.1% to 43.4%); of special note are the two indicators with 
significantly higher percentages of unacceptable decisions: number 1 (Areas of misunderstanding or 
difficulty are identified before students ask questions **or** no misunderstanding or difficulty 
occurs) (E=55.0%; S=56.4%) and number 3 (Bases for learner difficulties or misunderstandings are 
sought **or** no misunderstandings or difficulties occur **or** probhig is not necessary) 
(E=53.8%; S=55.5%). 
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PACE: The Uiree assessment indicators in this Teaching and Learning Component 
reference the teacher's ability to monitor and adjust the pace of teaching and learning acUvities in 
order to most effectively enliance student learning. Tlie percentages of acceptable decisions for the 
indicators in the total sample of classrooms (n) ranged from a high of 74.3% (Provides sufficient 
time for students to complete learning task(s) to a low of 32.5% (Summarizes or reviews during 
the lesson to monitor/assess the pace of teaching and learning). The differences in the percentages 
of unacceptable decisions between elementary and secondary groups were negligible. Of particular 
interest, however, is the significantly higher percentages of unacceptable decisions (relaUve.to the 
other indicators) obtained for assessment indicator number 2 Summarizes or review during the 
lesson to monitor/assess the pace of teaching and learning) (E=65.5%; S=69.4%). 

MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT: This STAR 
Teaching and Learning Component addresses the teacher's command of a rather complex array of 
monitoring and informal assessment strategies for gauging the students' understanding of both 
content and learning tasics. Interestingly, for this component, similar to the Thinking Skills 
Component, results for the total sample of classrooms (n) indicated rather high percentages of 
unacceptable decisions across the indicators. The percentages of unacceptable decisions for Uie six 
assessment indicators in Uiis component encompassed a range which included a high of 80.4% (A 
variety of levels of learning is assessed as appropriate) and a low of 43.3% (Monitors students' 
initial engagement in learning tasks). I'or assessment indicator numbers 1 through 4. Uie secondary 
sample group averaged approximately five percentage points higher in percentages of unacceptable 
decisions over the elementary sample group. For Uie remainder of the indicators (numbers 5 and 
6) there were no appreciable differences between the two groups in percentages. Of particular 
interest is tlie very high unacceptable percentases obtained for indicator number 5 (A variety of 
levels of learning is assessed as appropriate) (E=80.4%; S=80.5%). 

FEEDBACK: Tiie teacher's relative success in guiding and enhancing students' learning 
through providing specific feedback about their performances and mastery of learning objectives is 
the assessment focus of this STAR Teaching and Learning Component. An extremely narrow 
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range of rather high percentages of unacceptable decisions was obtained for the four indicators 
comprising this component. The percentages of unacceptable decisions for the total sample of 
classrooms (n) ranged from a high of 73.7% (Provides specific feedback to students when they 
have mastered leaminc objective(s)) to a low of 63.4% (Revisits students who have responded 
inadequately). Differences between the E and S groups on percentages of unacceptable decisions 
were iiegUgible. It is important to note that, like other key components in this Dimension - 
including Thinking SkUls and Monitoring Learning Tasks and Informal Assessment, all of the 
indicators witliin this Feedback Component obtained significantly high percentages of unacceptable 
decisions (average unacceptable percentage for elementary was 66.0%, for secondary, 67.5%). 

ORAL AND WRITTEN COMMUNICATION: This final STAR Teaching and Learning 
Component reflects an assessment consideration for the adequacy and appropriateness of oral and 
written communications from the teacher to the students. Of tlie seventeen components in 
Dimensions II through IV, this component received the highest percentage of acceptable decisions 
(see Table 1). For the four indicators comprising this component, all percentages of acceptable 
decisions for the total sample (N) exceeded 91%. 

SummariRs for Assessment hidicators Bv Each ST AR Component for Beginning and Experienced 
Teachers 

Summary data by beginning and experienced teachers were compiled in table form and 
printed elsewhere (Claudet, HUl, EUett & Naik, 1990). 

Classroom a nd Behavior Management : Summary da^a for percentages of acceptable and 
unacceptable assessment decisions for the total sample (n) and also by beginning (B) and 
experienced (E) teachers for each assessment indicator for each Teaching and Learning Component 
for Performance Dimension 11 (Classroom and Behavior Management) follow. 

TIME: This STAR Teaching and Learning Component focuses on efficient allocation and 
use of time for teacliin^ and learning activities. The percentages for acceptable assessment 
decisions ranged from a high of 92.9% (Minor interruptions are managed quickly and efficiently or 
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there are no interruptions) to a low of 21.4% (Expectations for maintaining and completing 
timelines for tasks are communicated to students). Tlie greatest difference in unacceptable 
decisions between beginning and experienced teachers is noted with indicator number 3 (There are 
no unnecessary delays during the lesson) (BT=34.3%; ET=21.9%). Other indicators of 
considerable difference in unacceptable assessment decisions include number 6 (Learning activities 
reasonably match the time allocated for learning) (BT=27.5%; £1=20.3% and number 7 
(Supplemental activities are provided as needed to fill the time allocated for learning) (BT=50.9%: 
ET=44.5%). Hie percentage of unacceptable decisions for the ofJier indicators for the begimiing 
and experienced teachers was quite similar. 

CLASSROOM ROUTINES: Focusing on tlie efficient and effective management of 
classroom routines necessary for the enliancement of learning this STAR Teaching and Learning 
Component includes four assessment indicators. Acceptable decision percentages for the total 
sample (N) of classrooms ranged from a high of 88.1% (Aids, materials and equipment are 
available and ready for use) to a low of 69.6% (The teacher gives clear administrative directions 
for classroom routines or no directions are needed). Tlie greatest variation between beginning and 
experienced teachers is noted in indicator number 1 (The attention of students is ensured before 
directions for routines are given or students are attending). Tlie percentage for unacceptable 
assessment decisions for the BT is 50.5% and 42.4% for tlie ET. 

STUDENT ENGAGEMENT: Results for this assessment indicator represent the percentage 
of assessments that maintained a mean student engagement rate at or exceeding 90%. The percent 
of classrooms assessed as acceptable was less tlian half (36.7%). An approximate 5% difference 
was noted between the beginning and tlie experienced teachers, with unacceptable otcisions being 
greater for the beginning teachers. 

MANAGING TASK-RELATED BEHAVIOR: This STAR Teaching and Learning 
Component focuses on monitoring and managing students* task-related behavior. Percentages for 
the assessment indicator decisions ranged from a high of 53.7% (Verbal and/or non-verbal 
techniques are used to redirect students who are persistently off-task or tliere is no persistent 
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off-task behavior) to a low of 43.3% (Efforts to redirect students who arc persistently off-task are 
successftil or there is no persistent off-task behavior). It should be noted that the percentage of 
unacceptable assessment decisions was consistently lower for the experienced teachers on each 
assessment indicator. 

MONITORING AND MAINTAINING STUDENT BEHAVIOR: The concerns reflected in 
this STAR Teaching and Learning Component deal witli effective management of acceptable and 
unacceptable student behavior. Tlie percentage of acceptable assessment decisions for this 
component ranged from 66.6% (Uses tecliniques to slop unacceptable behavior or none are. needed 
or there is no unacceptable behavior) to 35% (Students iie provided verbal and/or non-verbal 
feedback about acceptable and unacceptable behavior). Percentages of unacceptable assessment 
decisions for indicators number 4 (Students are provided verbal ano/or non-verbal feedback about 
acceptable and unacceptable behavior) (BT=65.9%; ET=65.2%), number 5 (Feedback provided to 
students about their behavior is consistent with behavioral expectations) (BT=66.3%; ET=62.6%), 
and number 6 (Uses positive feedback as a means of cuing behavior expectations for students as 
needed) (BT=68.7%; ET=64.7%) should be noted as ratlier large percentages of unacceptable 
decisions. For otlier assessment indicators, tlie difference in the percentage of unacceptable 
decisions for beginning and experienced teachers was approximately 10% and the unacceptable 
percentages were consistently higher for tlie beginning teachers. 

Learning Environment : A summary was compiled of percentages of acceptable and 
unacceptable assessment decisions for each assessment indicator for the two STAR Teaching and 
Learning Components in Performance Dimension III, Learning Environment. Results for the two 
Teaching and Learning Components are highlighted. 

PSYCHOSOCIAL: Assessment indicuiuir in "s STAR Teacliing and Learning Component 
focus on the quality of classroom climate aiiU positive interpersonal relationships between tlie 
teacher and students and among students. The percentages of acceptable assessment decisions 
varied from a high of 86.6% (Warmth and friendliness are demonstrated throughout tlie lesson) to a 
low of 37.8% (Enthusiasm for teaching, learning and tlie subject being taught is communicated to 
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students). The percentage of unacceptable assessment decisions for beginning and experienced 
teachers was quite similar. It is worth noting lliat in this particular STAR Teaching and Learning 
Component, the percentage of acceptable assessment decisions for beginning teacliings was slightly 
greater in indicators number 3 (Comments to or about students are free of sarcasm, ridicule, and 
derogatory, demeaning or humiliating remarks) (BT=79.2%; ET=77%), number 5 (comments, 
questions, examples, demonstrations and/or other contributions are sought from students throughout 
the lesson) (BT=53.1%; ET=52.5%), number 9 (Shows patience, empathy or understanding for 
students who respond poorly or who difficulty **or** no students have difficulty) (BT=76%; 
ET=74.1%), and number 10 (The lesson is personalized for students) (BT=40.8%; ET=39.2%). 

PHYSICAL: This focus of this STAR Teaching and Learning Component reflect concerns 
for tlie elements of a physical learning environment tliat enhances student learning. Overall, tlie 
percentages of acceptable assessment decisions for assessment 'Indicators within tliis component 
were ratlier high. Tlie percentage for acceptable decisions ranged from a high of 94.2% (The 
classroom is neat, safe, and arranged in an orderly manner) to a low of 76.6%(Display(s) create a 
pleasant atmosphere and serve a thematic/content-iclated purpose). Little difference was noted in 
the assessment results between tlie beginning and experienced teachers. 

Enhancement of Learning : Highlights of summary data follow for acceptable and 
unacceptable decision percentages for tlie total sample of classroom observations and also by 
beginning and experienced teachers for each assessment indicator for each Teacliing and Learning 
Component in STAR Performance Dimension IV (Enhancement of Learning). 

LESSON AND ACTIVITIES INITIATION: Unlike tlie relatively lower percentages of 
unacceptable decisions obtained for STAR components in Dunensions II and III for tlie beginning 
and experienced teacher groups, the percentages of u nacceptable decisions in Dimension IV are 
significantly higher for botli of tliese groups, beginning noticeably witli tliis first Dimension IV 
Component. The percentages for the unacceptable assessment decisions for beginning group ranged 
from a high a 88.7% (Clearly communicates tlie challenge of learning task(s) to students as 
needed) to a low of 46.5% (Procedural directions necessary to implement learning tasks are clear 
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and complete). The percentages of unacceptable decisions for the experienced teacher group rather 
closely foUowed this range with a iiigh of 86.7% and a low of 38.2% for the same two indicators. 
The differences between the beginning and experienced teachers relative to the percentages for each 
indicator were negligible for tlie most part, with the largest variation in percentages of unacceptable 
decisions occurring for indicators number 1 (BT=54.7%; ET=46.4%), number 5 (BT=46.5%; 
ET=38.2%), and number 6 (BT=81.4%; ET=73.0%). Of particular concern are the significantly 
high percentages of un acceptable decisions for four indicators in ihis component: number 4 (The 
purpose and importance of learning activities are communicated to students) (BT=83.0%; 
ET=81.6%0, number 6 (Expectations about student engagement in learning tasks are communicated 
at the beginning of activities) (BT=81.4%; ET=73.0%), number 7 (Clearly communicates the 
challenge of learning task(s) to students as needed (BT=88.7%; ET=86.7%), and nun ber 10 (As 
new ideas/concepts/activities are introduced, they are related to past and future learning) 

(BT=82.6%; ET=78.6%). 

TEACHING METHODS AND LEARNING TASKS: For tlie six assessment indicators 
comprising this component, the percentages of acceptable decisions were fairly well differentiated 
from high to low across tlie indicators for both groups witli the highest percentages of positive 
decisions occurring for the first two indicators, llie percentages of acceptable decisions for tlie 
beginning teacher group ranged from a high of 82.6% (Teacliing methods and learning tasks or 
topics within an activity are sequenced in a logical order) to a low of 25.1% (Provision is made for 
lesson/activities closure). The range of percentages of acceptable decisions for the experienced 
group closely paralleled BT group percentages witli a high percentage of 88.3% and a low 
percentage of 23.8% on tlie same indicators respectively. There was a close consistency between 
percentages for tlie BT and ET groups, with the largest variation being 6.5 percentage points for 
indicator number 5 (Methods and learning tasks used enliance mastery of learning objectives) 
(BT=44.0%; ET=50.5%). Overall, the ET group experienced slightly higher percentages than tlie 
ET group on these indicators. Of noteworthy interest is the rather percentages of unaccgptablg 
percentages of unacceptable decisions for botli BT and ET groups for indicator number 6 
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(Provision is made for lesson/activities closure) (BT=74.9%; ET=76.2%). 

AIDS AND MATERIALS: In this component, tlie percentages of acceptable decisions for 
tlie BT group ranged from a high of 71.5% (The use of teaching aids is appropriate for methods 
and objectives) to a low of 41.0% (Use of learning materials broadens student understandings and 
enhances learning). Although the percentages of acceptable decisions for the ET paralleled the BT 
group fairly well (the ET group had slightly higher percentages for the majority of indicators) tlie 
range of high and low percentages fell on different indicators for tlie ET group: a liigh of 73.7% 
(Teaching aids are used at appropriate times in tlie lesson) and a low of 47.9% (Learning materials 
are used properly and accommodate the range of needs and abilities of students. For the eight 
assessment indicator in this Teaching and Learning Component the percentages of acceptable 
decisions for both the BT and ET groups varied somewhat relative to tlie specific focus of 
individual indicators. The indicators receiving the highest percentages of acceptable decisions for 
both groups were tliose dealing primarily with assessment considerations of the teacher's and 
students' effective and timely use of appropriate aids and materials (indicator numbers: 1,3,5 and 
7). The highest percentages of unacceptable assessment decisions were obtained by tliree indicators 
dealing specifically witli tlie effective use of aids and materials and the resultant effect on students' 
learning enhancement: number 4 (The use of teachmg aids broadens understandings and enhances 
learning) (BT=55.0%; ET=49.8%), number 6 (Learning materials are used property and 
accommodate the range of needs and abilities of students) (BT=57.6%; ET=52.1%), and number 8 
(Use of leaming materials broadens student understaiidings and enhances learning) (BT=59.0%; 
ET=51.5%). 

CONTENT ACCURACY AND EMPHASIS: In this Teaching and Leaming Component a 
wide range of percentages of acceptable decisions occurred across tliis seven indicator set. There 
was a close consistency between BT and ET groups on percentages of acceptable decisions across 
indicators, with the high and low percentages occurring on the same indicators. Tlie highest 
percentages of acceptable decisions for the BT and ET groups was obtained for indicator number 3 
(Content knowledge is accurate and up-to-date) (BT=90.1%; 94.5%), while the lowest percentages 
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of acceptable decisions for the BT and ET groups were derived for indicator number 2 
(Emphasizes the value and importance of topics and acUvities) (BT=18.6%; ET=19.0%). Overall, 
the ET group experienced slightly higher percentages of acceptable decisions than the BT group. 
Four indicators obtained significantly higher percentages of unacceptable decisions compared to the 
other tliree. These four assessment indicators, interestingly, involved tlie most direct assessment 
concerns regarding tlie teacher's abiUty to "utUize" content and "emphasize" content knowledge in 
ways that would most effectively enliance students' learning: number 1 (Students are given 
opportunities to leani at more tlian one cognitive and/or performance level) (BT=68.7%; 
ET=67.7%), number 2 (Emphasizes the value and importance of topics and activities) (BT=81.4%; 
ET=81.0%), number 6 (Essential elements of content knowledge and/or performance tasks are 
emphasized) (BT=74.7%; ET=71.1%), and number 7 (Potential areas or points of difficulty are 
emphasized throughout Uie lesson) (BT=77.4%; ET=73.7%). 

THINKING SKILLS: This Dimension IV Teaching and Learning Component Ls somewhat 
singular in that all of the unacceptable assessment decisions for tlie eleven indicators comprising 
this set were all greater than 63%. Across the eleven indicators the percentages of unacceptable 
decisions between tlie BT and ET groups consistently paralleled each other very closely. The 
percentages of unacceptable decisions for the BT and ET groups were: high percentages - 
(BT=85.7%; ET=86.9%) (Provides opportunities for the extension of learning to new contexts), and 
low percentages - (BT=63.6%; ET=62.3%) (Wait time is used to enhance student learning). Of the 
three critical indicators dealing with the "what" of thinking (content) (indicators one tlirough three), 
all of these indicators obtained percentages of unacceptable decisions greater tlian 73%. The 
highest percentages of unacceptable decisions occurred for indicator number 3 (Involves students in 
developing principles and/or rules) (BT=85.5%; ET=84.7%). WhUe for Uie remiiuiing seven "how" 
of tliinking indicators (teachmg mctliods and learning tasks) both BT and ET group unacceptable 
percentages were similarly very high, of special note are tlie percentages of unacceptable decisions 
for indicator numbers 10 and 11: number 10 (Encourages creative thinking) (BT=84.6%; 
ET=85.8%), and number 11 (Provides opportunities for tlie extension of learning to new contexts 
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(BT=85,7%; ET=86.9%). For these two indicators, teachers from both BT aiid ET sample groups 
received less tlian 16% acceptable decisions. 

CLARIFICATION: Tlie five assessment indicators opcrationalizing tliis component reflect 
somewhat moderate percentages of acceptable decisions by boUi Bt and ET groups. An interesting, 
if predictable, characteristic of these percentages is that experienced teachers' percentages of 
acceptable decisions for these five indicators were aU somewhat higher than those for beginning 
teachers. Percentages of acceptable decisions for tlie BT group ranged from a 62.4% 
(Clarifications are made for individuals of smaU groups rather than for Uie entire class **or** this 
typ. of clarification is not necessary) to a low of 37.6% (Bases for learner difficulties or 
misunderstandings are sought ♦♦or** no misunderstandings or difficulties occur **or** probing is 
not necessary). The ET group ranged from a high of 64.2% (Clarifications are made for 
individuals or small groups...) to a low of 44.5% (Areas of misunderstanding or difficulty are 
identified before students ask questions **or** no misunderstanding or difficulty occurs). An 
average difference of 6.1 percentage points was evident between percentages of acceptable 
decisions for the Bt and ET groups. Of particular interest are tlie relatively high percentages of 
unacceptable decisions in both BT and ET groups for indicator numbers 1 (BT=62.0%; ET=55.5%) 
and number 3 (BT=62.4%; ET=54.5%). 

PACE: For tlic three assessment indicators comprising this Teacliing and Learning 
Component, the percentages of acceptable decisions for the BT and ET groups were consistently 
parallel. Two of the indicators (numbers 1 and 3) obtained moderately high percentages of 
acceptable decisions: number 1 (Learning activities are implemented at an appropriate pace) 
(BT=67.3%; ET=64.0%), and number 3 (Provides sufficient time for students to complete learning 
task(s) (BT=74.3%; ET=70.1%). Assessment indicator number 2, however, had disproportionately 
high percentages of unacceptable decisions: number 2 (Summarizes or reviews during the lesson to 
monitorVassess Uie pace of teaching and leaming) (BT=67.5%; ET=68.3%). This occurrence of 
very high percentages of unacceptable decisions for tliis indicator is consistent with similarly hij h 
percentages throughout oth^r areas of Dimension IV mentioned above, as well as in the foUowing 
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"Monitoring" component. 

MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT: The percentages 
of unacceptable decisions for the six assessment indicators in Uiis Teaching and Learning 
Component ranged from moderately high to very high. The differences in Uie percentages o^ 
unacceptable decisions between the BT and ET groups were sUght (Uie largest variation being 5.5 
percentages points). Overall, the percentages of unacceptable decisions for the BT group were a 
few points higher Uian for the ET group. Of particular note are the very high percentages of 
unac ceptable decisions obtained by boUi Uie BT and ET groups for indicator number 5 (A variety 
of levels of learning is assessed as appropriate) (BT=82.8%; ET=80.7%). 

FEEDBACK: Rather high percentages of unacceptable decisions occurred for both the BT 
and ET sample groups for tlie four indicators in tliis Teaching and Learning Component. The 
percentages of unacceptable decisions for the BT sample group ranged from a high of 79.4% for 
indicator number 4 (Provides specific feedback to students when they have mastered learning 
objective(s)), to a low of 65.5% for indicator number 3 (Revisits students who have responded 
inadequately). The percentages of unacceptable decisions for the ET sample group were fairly 
consistent, with some slight variations. The percentages of unacceptable decisions for the LT 
sample group ranged from a high of 73.4% for indicator number 4, to a low of 62.8% for indicator 
number 1 (Provides specific feedback to students about responses which are adequate and 
inadequate). Overall, the percentages of unacceptable decisions for the BT group were slightly 
higher than for the ET group. The largest variations between tlie two groups occurred for indicator 
number 4 (Provides specific feedback to students when they have mastered learning objective(s)) 
(BT=79.4%; ET=73.4%), and for indicator number 1 (Provides specific feedback to students about 
responses which are adequate and inadequate) (BT=68.3%; ET=62.8%). 

ORAL AND WRITTEN COMMUNICATION: This Teacliing and Learning Component 
received the highest percentages of acceptable decisions of the seventeen components in 
Dimensions II through IV (See Table I). All of tlie four indicators received percentages of 
acceptable decisions for both BT and ET groups exceeding 91.0%, with indicator numbers 1 
through 3 receiving percentages tlial exceeded 95.0%. 

ERIC 
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ri^^.rnom .nd Beh avior Management : Summary data were compiled fcr percentages of 
acceptable and unacceptable assessment decisions for each assessment indicator for each Teaching 
and Learning Component for Performance Dimension U (Classroom and Behavior 
Management)(Claudet, Hill, EUett & Naik, 1990). The groups are categorized by subject areas: the 
"Language" category encompasses foreign languages, English, reading, and language arts; "Math- 
includes mathematics, algebra, and calculus; "Science" represents environmental science, biology, 
physics, chemistry, and life science; and "Social sciences" includes social studies, history, 
geography, and civics. Results are highlighted for each component. 

TIME: This STAR Teaching and Learning Component focuses on efficient allocation and 
use of time for teaching and learning activities. TTie percentages for acceptable assessment 
decisions ranged from a high of 94.2% (Minor interruptions are managed quickly and efficiently 
**or** Uiere are no interruptions) in the science group to a low of 18.4% (Expectations for 
niaintaining and completing timelines for tasks are communicated to students) for the math group. 
AU group percentages for acceptable decisions were lowest in Uiis assessment indicator (D=20.3%; 
M=18.4%; S=20.8%; SS=25%). The rather high percentages of unacceptable assessment decisions 
for indicator number 7 (Supplemental activities are provided as needed to fiU the time allocated for 
learning) are also worth noting. For this assessment indicator. Uie largest difference in the 
percentage of unacceptable decisions was noted between the math and social science groups with 
the unacceptable percentages higher for maUi classrooms. Tlie difference in percentages for 
unacceptable decisions in assessment indicator number 1 (Learning activities begin promptly) 
(L:=9.2%; M=9.0%; S=15.3%; SS=16.1%) is also wortli noting. 

CLASSROOM ROUTINES: llie efficient and effective management of classroom routines 
necessary for Uie enhancement of learning is the focus of this STAR Teaching and Learning 
Component. Percentages of acceptable decisions for assessment indicators ranged from a high of 
90.0% (Aids, materials and equipment aic available and ready for use) for tlie maUi group to a low 
of 49.4% (Tlie attention of students is ensured before directions for routines are given **or** 
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students are attending) for the science group. The percentage of unacceptable decisions was 
highest for the science group for each assessment indicator and lowest for the matli group on three 
of the four comparisons. The greatest difference evident in the percentage of unacceptable 
decisions was noted in indicator number 2 (The teacher gives clear administrative directions for 
classroom routines **or** no directions are need) between math and science groups (M=27.8%; 
S=37.1%). 

STUDENT ENGAGEMENT: Results for this Teaching and Learning Component show the 
percentage of classrooms tliat were assessed as maintaining mean student engagement in learning 
tasks at or exceeding 90%. Tlie percentage of acceptable decisions for tliis assessment indicator 
for each subject area was less than half of the sample for each area. The acceptable decisions 
ranged from a high of 40.% for tlie social science group to a low of 34.1% for tlie science group 
with the difference being approximately 6%. 

MANAGING TASK-RELATED BEHAVIOR: This STAR Teaching and Learning 
Component consists of six assessment indicators focusing on monitoring and managing students' 
task-related behavior. Percentages of acceptable assessment decisions for the various subject areas 
ranged from a high of 56.4% (Verbal and/or non-verbal tecliniques are used to redirect students 
who aie persistentiy off-task ♦*or** there is no persistent off-task behavior) for the math group to 
a low of 31.5% and 31.7% (Active involvement .is sought from students who are passively 
involved in learning **or** no students are only passively involved) for the social science and 
science groups. Percentages of acceptable as essment decisions for language and math classes 
were lowest for indicator number 6 (Efforts to redirect i>tudents who are persistently off-task are 
successful **or** there is no persistent off-task beha\ ur) (L=43.6%; M=45.1%). The greatest 
differences in percentages of unacceptable decisions werv' noted between math and science classes 
for assessment indicators number 2 (Active involvement is sought from students who are passively 
involved in leaming**or** no students are only passively involved) (M=54%; S=68.3%), number 3 
(Pays attention to/monitors momentary off-task behavio-- tliroughout the lesson **or** there is no 
momentary off-task behavior) (M=44.8%; S=57.1%), number 4 (Verbal and/or non-verbal 
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techniques are used to redirect students who are persistently off-task **or** tliere is no persistent 
off-task behavior) (M=43.6%; S=56%) and number 5 (Uses techniques for maintaining the 
engagement of students who have been redirected **or** there is no persistent off-task behavior) 
(M=50.4%; S=63.1%). lliese summary results suggest that STAR assessors viewed indicators in 
this component more favorably for math classes than science classes. Tlie percentage of decisions 
for each subject area for each assessment indicator was slightly below to above 50% unacceptable. 

MONITORING AND MAINTAINING STUDEOT BEHAVIOR: Tlie focus of this STAR 
Teaching and Learning Component is on effective management of acceptable and unacceptable 
student behavior. Percentages of acceptable decisions were greatest for indicator number 3 (Uses 
appropriate methods to prevent/diffuse situations in which unacceptable behavior may occur **or** 
there is no unacceptable behavior) for the math group (M=67.7%). Language, science, and social 
science groups' percentages for acceptable decisions were greatest for indicator number 7 (Uses 
techniques to stop unacceptable behavior **or** there is no unacceptable behavior) (L=67.8%; S= 
60.1%; SS=62.9%). The rather high percentages of unacceptable decisions for assessment 
indicators number 4 (Students are provided (verbal and/or non-verbal) feedback about acceptable 
and unacceptable behavior), number 5 (Feedback provided to students about their behavior is 
consistent witli behavioral expectations), and number 6 (Uses positive feedback as a means of 
cuing behavior expectations for students as needed) are also worth noting. Percentages of 
unacceptable assessment decisions were greatest for tlie science group for six. of the nine indicators 
in this Teaching and Learning Component and greatest for the other three indicators in the social 
science group. 

Learning Environment : Summary data of acceptable and unacceptable decisions for 
assessment indicators from STAR Performance Dimension III, Learning Environment were 
compiled. Results are highlighted for the two Teaching and Learning Components. 

PSYCHOSOCIAL: Assessment indicators in this STAR Teaching and Learning Component 
focus on the quality of the classroom climate and interpersonal relationships between teacher and 
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students and among members of the class. The percentages of acceptable decisions for each 
subject area varied from a high of 87.6% (Warmth and friendliness are demonstrated throughout 
the lesson) for the maUi group to a low of 30.6% (Enthusiasm for teaching, learning and the 
subject being taught is communicated to students) for Uie social science group and 30.6% (The 
lesson is personalized for students) for the math group. The greatest percentage of acceptable 
assessment decisions for each group was noted for assessment indicator number 2 (Warmth and 
friendliness are demonstrated Uiroughout the lesson) (L=86.5%; M=87.6%; S=87.1%; SS=84.2%). 
Tlie rather high percentages of unacceptable decisions for indicators number 5 (Comments, 
questions, examples, demonstrations and/or other contributions are sought from students throughout 
the lesson) (L=41.6%; M=46.1%; S=52.6%; SS=56.3%) and number 12 (Students are given reasons 
for actions, decisions or directives made by the teacher as needed) (L=43.1%; M=40.7%; S=40.1%; 
SS=40.4%) are also wortli noting. The greatest difference between groups for percentages of 
unacceptable assessment decisions was noted for indicator number 10 (The lesson is personalized 
for students) with an approximate 16% difference between math and science groups (M=69.4%; 
S=53.4%). Indicators number 5 (Comments, questions, examples, demonstrauons and/or other 
contributions are sought from students throughout tlie lesson) (L=41.6%; M=46.1%; S=52.6%; 
SS=56.3%) and number 6 (Considers, recognizes and/or comments on students contributions) 
(b=32.1%: M=33.3%; S=44.2%; SS=39.5%) depict notable differences in percentages of 
unacceptable assessment decisions between groups. It should also be noted that the percentages of 
unacceptable decisions were greatest for the social science group on six of the twelve assessment 
indicators. 

PHYSICAL: The focus of this STAR Teaching and Learning Component reflects a 
concem for tlie elements of a physical learning environment tliat enhances tlie learning of all 
students. Each of tlie four indicators in this component had acceptable percentages slightly below 
or above 75%. Hie percentages of acceptable decisions ranged from a high of 95.6% (Tlie 
classroom is neat, safe and arranged in an orderly manner) for the language group to a low of 
73.9% (Display(s) create a pleasant atmosphere and serve a thematic/content-related purpose) for 
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the social science group. Results also show this indicator having the greatest difference in 
unacceptable decisions between groups (L=18.3%; M=22.3%; S.-=23.2%; SS=26.1%). 

Enhancement of Learning : Summary duta were compiled for percentages of acceptable and 
unacceptable decisions for each assessment inaicator for each Teaching and Learning Component 
for Performance Dimension IV. Results are highlighted for each component. 

LESSON AND ACTIVITIES INITIATION: For tlie ten assessment indicators comprising 
this first Dimension IV Teaching and Learning Component higher percentages of acceptable 
decisions were obtained for tlie majority of indicators (numbers 1, 2 (language only), 5-10) .for the 
Language and Math sample subgroups over the Science and Social Studies classroom subgroups. 
Overall, the variations in percentages between tlie Language and Math subgroups, as well as the 
Science and Social Studies subgroups, were negligible. In two cases, the Science subgroup 
obtained percentages of acceptable decisions that were slightly higher tlian the other tliree 
classroom groups: indicator 3 (Clearly communicates specific learning outcomes to students) 
(8=30.0%; L=28.4%; M=28.3%; SS=:25.9%), and indicator 4 (The purpose and importance of 
learning activities are communicated to students) (S=19.0%; M=18.9%; 1^17.7%; SJ=17.2%). 
Also, in one instance, the Social Studies subgroup received the highest percentage of acceptable 
decisions: indicator 10 (As new ideas/concepts/activities are introduced, they are related to past and 
future learning) (SS=25.9%; S=23.0%; M=21.1%: L=20.4%). 

TEACHING METHODS AND LEARNING TASKS: For the six assessment indicators in 
Teaching and Learning Component, as for tlie preceding indicator, the Matli and Language sample 
groups received generally higher percentages of acceptable decisions as compared with the Science 
and Social Studies sample groups. Tlie Math sample subgroup, for five out of the six indicators, 
received the highest percentages of acceptable decisions. There was one notable exception to tliis, 
however, (with the Matli sample group receiving tlie lowest percentage, and tlie Language sample 
group receiving the highest percentage) in the distribution of acceptable decisions for indicator 6, 
(Provision is made ror lesson/activities closure) (L=27.4%; S=26.4%; SS=25.7%; M=23.6%). For 
the most part, the variations among ranges of percentages between the sample groups was slight to 
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moderate, with larger variations occurring for indicator 1 (Use of methods is appropriate for the 
complexity of lesson content (L=75.1%: M=77.9%: 8=71.2%; SS=61.8%). indicator 3 (Uses two or 
more methods that enhance student interest and actively involve students in learning tasks) 
(D=57.1%; M=59.6%: 8=49.2%; SS=42.4%), and indicator 4 (The teacher and the students interact 
in more than one group size) (U=58.8%; M=68.3%; 8=47.8%, 88=41.3%). 

AID8 AND MATERIAL8: Li Uiis Teaching and Learning Component, Uie percentages of 
acceptable decisions for the Language, MaUi and 8cience subgroups were, for the most part, rather 
closely distributed, wliile tlie percentages of acceptable decisions for the Social Studies subgroup 
averaged 9.6 percentage points below Uie lower percentage range of the other three subgroups. 
The widest variation in percentages of acceptable decisions among the four subgroups occurred for 
indicator 2 (Teaching aids arc used properly and accommodate the range of student needs and 
abiUties) (M=64.5%; 1^63.7%; 8=61.3%; 88=36.5%). 

CONTENT ACCURACY AND EMPHA8I8: For the seven assessment indicators 
comprising Uiis Teaching and Learning Component 'he variation in percentages of acceptable 
decisions among Uie four subject area subgroups was relatively slight, with die Math subgroup 
receiving the highest percentages of acceptable decisions for the majority of indicators (indicators 
3-7). Although the Language and Math subgroups did obtain the higher percentages (as compared 
with the Science and Social Studies subgroups simUar to die previous Dimension IV indicators) 
in over 50% of the indicators (indicator 3-5, & 7), Uiere were some interesting exceptions to this 
pattern where the Science and/or Social Studies subgroups received die highsi percentages for 
certain indicators (with the Language and/or MaUi percentages dropping appreciably): indicator 1 
(Students are given opportunities to learn at more than one cogniUve and/or performance level) 
(8=39.3%; L=33.7%; 88=33.5%; M=29.1%), indicator 2 (Emphasizes tlie value and importance of 
topics and activities) (88=23.9%; 8=23.4%; L=17.6%; M=16.6%), and indicator 6 (Essential 
elements of content knowledge and/or performance tasks are emphasized) (M=32.8%; S=30.4%; 
88=28.3%; L=2.j.8%). 
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THINKING SKILLS: As already mentioned above, this STAR Teaching and Naming 
Component is rather unique in that it obtained the lowest overaU percentages of acceptable 
assessment decisions of the seventeen STAR components comprising Dimensions H-IV (21.56% of 
Maxunum. n=5720). For Uie eleven indicators in tliis component, the percentages of acceptable 
decisions were rather closely distributed across the four subject area subgroups, with a few notable 
exceptions. There were some larger variations among subgroups in three indicators: indicator 4 
(Encourages students to think of and recall examples from their own experiences) (L=28.0%; 
M=12.4%; S=29.6%; SS=25.7%). indicator 7 (Wait time is used to enhance student learning) 
(L=44.0%; M=40.3%; S=36.3%; SS=32.1%). and indicator 8 (Encourages critical analysis and/or 
problem solving) (L=16.2%; M=25.9%; S=21.2%; SS=13.8%). As the percentages of acceptable 
decisions were, for the most part similar across the subgroups, there were some interesting 
variations among individual subgroups. In six of Uie eleven indicators the Math subgroup received 
the lowest percentages of acceptable decisions: indicator 1 (21.1%). indicator 4 (12.4%). indicator 5 
(11.8%). indicator 6 (26.0%). indicator 10 (10.2%). and indicator 11 (12.3%). However, in three 
other indicators the Math subgroup received the highest percentages: indicator 3 (19.4%). indicator 
8 (25.9%) and indicator 9 (22.0%). Also, Uie "wait time" indicator obtained somewhat higher 
percentages for the Language and Math subgroups (L=.44.0%; M=40.3%) than for the Science and 
Social Studies subgroups (S=36.3%; SS=32.1%). 

CLARIFICATION: For Uie six indicators comprising this Teaching and Learning 
Component, the Language and Math subgroups received overall higher percentages of acceptable 
decisions as compared with the Science and Social Studies subgroups. This is consistent with a 
similar pattern for other components noted earlier. Interestingly, in five of the six indicators. Uie 
Science subgroup obtained Uie lowest percentages of acceptable decisions of Uie four subgroups. 

PACE: SimUarly. in Uiis Teaching and Learning Component. Uie Language and MaUi 
subgroup obtained somewhat higher percentages of acceptable decisions Uian Uie Science and 
Social Studies subgroup. The largest variaUon in percentages across Uie four subject area 
subgroups occurred for indicator 1 (Learning activities arc implemented at an appropriate pace) 
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(b=70.1%; M=64.8%; S=61.1%; SS=60.3%). 

MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT: In this Teaching 
and Learning Component the high performance of the Language and Matli subgroup as compared 
with 'Ne Science and Social Studies subgroup is also apparent. Of tlie six indicaloi^ in this 
component the most significant variations in percentages among tlie four subject area subgroups 
occurred in: indicator 1 (Monitors students' initial engagement in learning tasks) (L=58.8%; 
M=58.3%; S=44.2%; SS=48.2%), indicator 2 (Monitors students' engagement during learning tasks) 
(b=54.2%; M=58.3%; S=41.3%; SS=40.8%). indicator 4 (Solicits a range of responses from 
students for informal assessment purposes) (U41.2%; 44.3%; 29.0%; 33.0%). and indicator 6 
(Adjustments witliin the lesson are made as needed **or** no adjustments are necessary) 

(L=48.6%; M=50.4%; S---4C.9%; SS=40.8%). 

FEEDBACK: For the four indicators in tliis Teacliing and learning component, there were 
substantially higher percentages of acceptable decisions obtained by Uic Language and Math 
subgroups, as compared to tlie Science and Social Studies subgroups. The Math subgroup received 
the highest acceptable percentages for all foar indicators, while the Social Studies subgroup 
received the lowest percentages for aU four indicators. The most significant variations in 
percentages across the four subject area subgroups occurred for indicator 3 (Revisits students who 
have responded inadequately) (L=37.4%; M=45.0%; S=25.6%; SS=24.3%). and indicator 4 
(Provides specific feedback to students when they have mastered learning objectives) (D=25.5%; 

M=30.8%; S=17.5%; SS=15.8%). 

ORAL AND WRITTEN COMMUNICATION: This Teaching and Learning Component 
was the only component of the seventeen in Dimensions U-IV that obtained an overaU percentage 
of maximum possible acceptable decisions in the above 90% range (94.70% of Maximum. 
n=5720). WiUiin Uiis component, there was no appreciable variation noted in percentages of 
acceptable decisions obtained for four subject area subgroups for indicators 1-3. Indicator four 
registered slight variation among the four subgroups, witli tlie Language subgroup obtaining the 
highest percentage of acceptable decisions, while tlie Social Studies subgroup obtained the lowest: 
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indicator 4 (Communication is precise with few false starts, interrupters or inappropriate qualifiers) 
(1^92.5%; M=91.9%; S=90.5%; SS=87.9%). 

Summary Analysis for Assessment Indicators Bv Each ST A R Componen t "Within" Pgrformangg . 
Grou p (Subject Areas: Art. Rand. Elective Courses, and Physical Educa tion) 

Classroom and Behavior Management : A summary of ^he percentage of acceptable and 
unacceptable assessment decisions for each assessment indicator for each STAR Teaching and 
Learning Component for Performance Dimension U (Classroom and Behavior Management) was 
compUed (Claudet, HiU, EUett & Naik, 1990). The results were computed for classroom settings in 
ait (A), band (B). electives (EL), and physical education (PE). Electives include business 
education, health occupations, home economics, and trade and industrial classrooms. The results 
are highlighted below. 

TIME: Tliis STAR Teaching and Learning Component focuses on the efficient allocation 
and use of time for teaching and learning activities. Percentages of acceptable assessment 
decisions vary from a high of 92.4% in elective courses for indicator number 5 (Minor 
interruptions are managed quickly and efficiently **or** tliere are no interruptions) to a low of 
23.3% for physical education for indicator number 2 (Expectations for maintaining and completing 
timelines for tasks are communicated to students). Percentages of acceptable decisions for 
indicator number 2 (Expectations for maintaining and completing timelines for tasks are 
communicated to students) were the lowest for each subject area (A,B,EL,PE). The greatest 
difference for unacceptable decisions is noted for indicator number 8 (Learning activities continue 
until the end of the allocated time period). Tlie unacceptable percentages range from a high of 
30.5 for electives to a low of 12.9% for band classes. 

The mean percentages of maximum possible for each subject area in Performance 
Dimension il (Classroom Behavior and Management) and tlie Star Teacliing and Learning 
Component A (Time) were: Art, 72.0%, Band 78.9%, Electives 72.4%, and Physical Education, 
71.7%. Tlitse summary results suggest tliat STAR assessors viewed band settings more favorably 
than other areas. 
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CLASSROOM ROUTINES: Tlie concern for efficient and effective management of 
classroom routines necessary for enliancement of students' learning is reflected in tlie STAR 
Teacliing and Learning Component. The percentages of acceptable decisions ranged from a low of 
55.4% (A) (The attention of students is ensured before directions for routines are given ♦♦or** 
students ai« attending) to a high of 87.1% (PE) (Aids, materials and equipment are available and 
ready for use). The difference in percentages for unacceptable decisions was greatest for indicator 
number 1 (The attention of students is ensured before directions for routines are given **or** 
students are attending) (B=31.4%; EL=47.6%). The difference between percentages for number 4 
(Routine tasks are dealt with in an efficient manner) (A=23.8%; B=17.1%; Eb=14.1%; PE---m4%) 
is also wortli noting. 

STUDENT ENGAGEMENT: Decisions for tliis STAR Teaching and Learning Component 
show the percentage of classroom settings that maintained an overall classroom engagement rate in 
learning tasks at or exceeding 90%. The percentages of assessment decisions range from a low of 
29.7% (A) to a high of 42.9% (B). The difference in tlie percentage of unacceptable decisions was 
13.2% favoring tlie subject area of band. Tlie difference between elective courses and physical 
education was negligible. 

MANAGING TASK-RELATED BEHAVIOR: The indicators comprising this STAR 
Teaching and Learning Component address a concern for monitoring and managing students' task 
related behavior. Results indicate percentages for acceptable assessment decisions range from a 
low of 39.2% (PE) (Efforts to redirect students who are persistently off-task are successful ♦*or** 
there is no persistent off-task behavior) to a high of 67.1 (B) (The teacher provides frequent 
changes in stimuli tliroughout tlie lesson to ensure learner attention and engagement in learning 
task(s)). Differences between subject areas in liie percentages of unacceptable decisions for 
indicators number 1 (Tlie teacher provides frequent changes in stmiuli tliroughout the lesson to 
ensure learner attention and engagement in learning task(s)) (A=50.5%; B=32.9%; EL=50.0%; 
PE=47.1%) and number 3 (Pays attention to/monitors momentary off-task behavior throughout the 
lesson ♦*or** there is no momentary off-task behavior) are wortli noting. 
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MONITORING AND MAINTAINING STUDENT BEHAVIOR: Addressed in this STAR 
Teaching and Learning Component is a concern for effective management of acceptable and 
unacceptable student behavior. Percentages for acceptable assessment decisions are lowest for each 
subject area for indicator number 6 (Uses positive feedback as a means of cuing behavior 
expectations for students as needed) (A=28.7%; B=40.0%; Eb=30.6%; PE=30.4%) and highest for 
indicator number 7 (Uses techniques to stop unacceptable behavior **or** none are needed **or** 
there is no unacceptable behavior) (A=63.4%; 3=77.1%; PE=63.3%) wiUi the exception of elective 
courses which a higher percentage was viewed acceptable for indicator number 3 (Uses appropriate 
methods to prevent/diffuse situations in which unacceptable behavior may occur ♦♦or** there is no 
unacceptable behavior) (EL=70%). The greatest difference in percentages of unacceptable 
assessment decisions between subject areas is noted in indicator number 2 (Behavior of the entire 
class is effectively monitored tliroughout the lesson)(A=42.6%; B=32.9%; EL=44.1%; PE=48.3%). 
The difference in the percentage for band and physical education is 15.4% favoring the band 
classroom settings. 

I.p.aminp Environment : Summary data were compiled of acceptable and unacceptable 
assessment decisions for assessment indicators from STAR Performance Dimension UI, Learning 
Environment. Results are highlighted for the two Teacliing and Learning Components. 

PSYCHOSOCIAL: The focus of this STAR. Teaching and Learning Component is on tlie 
quaUty of the classroom climate and positive interpersonal relationships between the teacher and 
students and among students. The percentages of acceptable decisions for indicators vary across 
groups ranging from a high of 88.2% (Warmth and friendliness are demonstrated Uiroughout the 
lesson) for the elective group to a low of 25.4% ('Ilic lesson is personalized for students) for the 
physical education group. The greatest percentage of acceptable assessment decisions for art, 
elective courses, and physical education are found in indicator number 2 (Wanntli and friendliness 
are demonstrated tliroughout the lesson) (A=85.1%: EL.-=88.2%; PE=83.8%). For the band group, 
assessment indicator number 11 (Is fair and impartial in dealings witli students) (B=82.9%) shows 
the greatest number of acceptable decisions. Indicator number 10 (The lesson is persona'ized for 
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students) (A=64.4%; B=48.2%; EL=48.2%; PE=74.6%) appears to indicate the greatest number of 
unacceptable decisions with Uie exception of the elective group (Enthusiasm for teaching, learning 
and the subject being taught is communicated to students) (EL=61.8%). Hie rather high 
percentage of unacceptable assessment decisions for indicator number 5 (Comments, questions, 
examples, demonstrations and/or oUier contributions are sought from students Uiroughout the 
lesson) (A=58.4%; B=38.6%; EL=48.2%; PE=:67.5%) is worUi noting. The greatest difference 
'28.9%) between groups is also noted in tliis assessment indicator. 

PHYSICAL: This set of four assessment indicators focuses on a concern for the elements 
of a physical learning environment that enhances the learning of all students. The percentage of 
acceptable assessment decisions were rather high for Uiis Teaching and Learning component with 
the exception of indicator number 2 (Display(s) create a pleasant atmosphere and serve a 
thematic/content-relatcd purpose) for the physical education group (45.4%). Tlie lowest percentage 
of acceptable decisions for each group was for tliis mdicator (A=70.3%: B=74.3%; EL=70.6%; 
PE=45.4%). The percentage of acceptable decisions range from a high of 95.7% (The functional 
Clements of tlie learning environment are arranged to effectively implement learning activities) for 
the band group to a low of 45.4% (Display(s) create a pleasant atmosphere and serve a 
thematic/content-related purpose) for Uie physical education group. Assessment results show the 
largest difference between the percentages of unacceptable decisions for indicator number 3 (Tlie 
functional elements of the learning environment are arranged to effectively implement learning 
a-tivities) for the art (12.9%) and the band (4.3%) groups. 

p.ptl^n^ ^"^p-nt nf Leaming : A summary was compUed of acceptable and unacceptable 
assessment decision percentages for each indicator for each STAR Teaching and Uaming 
Component for Performance Dimension IV, (Enliancement of Leaming). Tlie results are 

highlighted for each component. 

LESSON AND ACTIVITIES INniAnON: For the ten indicators comprising this 
Teaching and Learning Component, Uierc was sUglit to moderate variation m acceptable decision 
percentages in four the indicatore (indicators 1-3, & 5). The Band subgroup received moderate to 
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significanUy higher percentages Uian the other tliree performance subgroups in eight indicators 
(indicators 3-11). A significant higher percentage of acceptable decisions relative to Uie other three 
subgroups was obtained by the Band subgroup for indicator 8 (Encourages aU students to 
participate) (A=55.4%: B=71.4%; E=48.8%; P.E.=57.5%); whereas tlie P.E. subgroup received a 
significantly IsmSL percentage of acceptable decisions as compared to the oUier subgroups for 
indicator 10 (As new ideas/concepts/activities are introduced, they are related to past and future 
learning) (A=26.7%; 8=34.3%; E=31.8%; P.E.=12.5%). 

TEACHING METHODS AND LEARNING TASKS: For the six assessment indicators in 
this Teaching and Learning Component variation in percentages of acceptable decisions across the 
four performance subgroups was moderate for the most part, with some significant variations 
occurring in specific indicators. For aU six indicators, the Band subgroup obtained the highest 
percentages of acceptable decisions, whUe in four of the six indicators (indicators 1-3, & 5) the 
P.E. subgroup received the lowest percentages. The indicators demonstrating Uie widest variation 
in percentages of acceptable decisions among subgroups were indicator 3 (Uses two or more 
methods that enhance student interest and actively involve students in learning tasks) (A=49.5%; 
B=71.4%; E=49.4%; P.E.=46.7%), and indicator 5 (Metliods and learning tasks used enhance 
mastery of learning objectives) (A=55.4%; B=62.9%; E=46.5%; P.E.=45.0%). 

AIDS AND MATERIALS: In this Teaching and Learning Component Uie Art and Band 
performance subgroups obtained moderate to significant higher percentages of acceptable decisions 
as compared to the electives (business educ, health educ, & home economics courses) and P.E. 
subgroups. In the two indicators dealing specifically wiUi using aids and materials in ways that 
••broaden and enlianced student learning", the differences between these two groupings were 
especially pronounced: indicator 4 O'he use of teaching aids broadens understandings and enhances 
learning) (A=58.4%; B=64.3%; E=48.2%; P.E.=43.8%), and indicator 8 (Use of learning materials 
broadens student understandings and enhances learning) (A=62.4%; B=77.1%; £=52.4%; 
P.E.=46.3%). The Band subgroup obtained Uie highest percentages of acceptable decisions for 
seven of eight indicators, whUe the P.E. subgroup obtained the lowest percentages of acceptable 
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decisions for six of eight Indicators. Of particular interest are the relatively high percentages of 
un^jceptaMe decisions for the P.E. subgroup (as compared to the other performance subgroups) for 
three indicators: indicator 4 (A=41.6%; B=35.7%: E=51.8%; P.E.=56.3%). indicator 6 (A=30.7%; 
B=27.7%: E=44.7%; P.E.=55.0%). and indicator 8 (A=37.6%; B=22.9%; &=47.6%: P.E.=53.8%). 

CONTENT ACCURACY AND EMPHASIS: For the seven assessment indicators in this 
Teaching and Uaming Component, the Band subgroup obtained significantly higher percentages of 
acceptable decisions as compared with the other three subgroups in four indicators: indicator 1 
(Students are given opportunities to learn at more tlian one cognitive and/or performance level) 
(A=34.7%; B=40.0%; E=30.6%; P.E.=15.4%). indicator 5 (Directions and explanations related to 
lesson content and/or learning tasks are effective) (A=56.4%; B=71.4%%; E=57.1%; P.E.=56.7%), 
indicator 6 (Essential elements of content knowledge and/or performance tasks are emphasized) 
(A=27.7%; B=45.7%; E=26.5%; P.E.=24.2%). and indicator 7 (Potential areas or points of 
difficulty arc emphasized throughout the lesson) (A=28.7%; B=55.7%: E=21.2%; P.E.=23.8%). Of 
particular note are Uie significantly high percentages of u oaccgptable decisions obtained by the P.E. 
subgroup (compared to the other three performance subgroups) for indicators 1 and 2: indicator 1 
(Students are given opportunities to learn at more than one cognitive and/or performance level) 
(A=65.3%; B=60.0%; E=69.4%; P.E.=84.6%). and indicator 2 (Emphasizes Uie value and 
importance of topics and activities) (A=79.2%; B=70.0%; E=67.6%; P.E.=87.1%). 

THINKING SKILLS: In the eleven indicators comprising tliis Teaching and Learning 
Component, Uicre was sUght to moderate variation in evidence among percentages of acceptable 
decisions in Uie Art. Band and Elective subgroups, with the percentages obtained for the P.E. 
subgroup significantly lower than Uiese other three subgroups in ten of eleven indicators. In three 
specific indicators, the Band and Elective subgroups received appreciably higher percentages of 
acceptable decisions than the Art and P.E. subgroups: indicator 1 (Associations are taught and used 
in learning) (A=16.8%; B=28.6%; E.^27.1%; P.E.=10.8%). indicator 2 (Evolves students in 
developing concepts) (A=12.9%: B=21.4%; E=17.1%: P.E.=10.0%). and indicator 7 (Wait time is 
used to enhance student learning) (A=23.8%; B=41.4%; E=32.9% P.E. 15.8%). Also, of interest 
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arc tlie significantly higher percentages of acceptable decisions obtained by the Art and Band 
subgroups (as compared to the Elective and P.E. subgroups) for indicator 10 (Encourages creative 
thinking) (A=32.7%; B=21.4%; E=10.6%; P.E.=4.2%), and, to a lesser extent, indicator 11 
(Provides opportunities for tiie extension of learning to new contexts) (A=17.8%; 21.4%; E=14.1%; 
^.E=7.9%). In indicator eleven just mentioned, and in indicator 5 (Encourages students to use 
mental imagery) (A=24.8%; B=11.4%; E=11.8%; P.E.=7.1%), Uie Art subgroup received the 
highest percentages of acceptable decisions. 

CLARIFICATION: For the five assessment indicators comprising this Teaching and 
Learning Component, characteristics noted above in earlier components in Dimension IV are 
retlected here as well. For four of the five indicators, the Band performance subgroup received 
moderately higher percentages of acceptable decisions than the other three subgroups. Also, m 
four of the five indicators the P.E. subgroup obtained the lowest percentages. The widest variation 
in percentages of accenta.ble decisions among the four performance subgroups occuned in indicator 
2 (Different words or examples are used in clarification **or** no clarification is needed) 
(A=48.5%; B=65.7%; E=58.8%, P.E.=50.4%), and indicator 3 (Bases for learner difficulties or 
misunderstandings are sought **or** no misunderstandings or difficulties occur **or** probing is 
not necessary) (A=42.6%; B=54.3%; E=47.1%; P.E.=42.:%). Of particular note are the somewhat 
higher percentages of acceptable decisions obtained by tlie Art and Elective subgroups for indicator 
4 (Clarifications are made for individuals or small groups rather than for the entire class **or** 
this type of clarification is not necessary) (A=74.3%; D=65.7%; E=74.1%; P.E.=60.0%). This may 
be due, simply, to tlie nature of tlie "kinds" of learning activities normally occurring in these types 
of classrooms, allowing slightly more opportunities for individual attention. 

PACE: Of the tliree assessment indicators comprising this Teaching and Learning 
Component, indicator 3 (Provides sufficient time for students to complete learning task(s)) obtained 
the most consistency in percentages of acceptable decisions across the four performance subgroups 
(A=79.2%; B=77.1%; E=75.3%; P.E.=72.9%). For tlie otlier two indicators, tlie Band subgroup 
obtained significantly higher percentages of acceptable decisions than tlie otlier tliree subgroups: 
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indicator 1 (Learning activities are implemented at an appropriate pace) (A=73.3%; B=84.3%; 
E=68.8%; P.E.71.3%), indicator 2 (Summarizes or reviews diuing the lesson to monitor/assess tlie 
pace of teaching and learning) (A=21.8%; B=48.6%; E=27.6%; P.E.=23.8%). Of special note are 
the moderately to significantly high percentages of unacceptable decisions obtained by aU fm. 
subgroups for indicator 2 (A=78.2%; B=51.4%; E=72.4%; P.E.=76.3%) over the other two 
indicators. 

MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT: Consistent with 
results obtained for earlier components in Dimension IV, the Band subgroup received significantly 
higher percentages of acceptable decisions for all six of the indicators in tliis component as 
compared with the other tliree performance subgroups. The Art, Elective and P.E. subgroups 
experienced slight to moderate variation among tliemselves in percentages of acceptable decisions 
for these six indicators. Of particular interest are tlie very high percentages of unacceptable 
decisions obtained by the Art, Elective and P.E. subgroups for indicators 4 and 5: indicator 4 
(solicits a range of responses from students for informal assessment purposes) (A=73.3%; 
B=55.7%; E=74.7%; P.E.=81.3%), indicator 5 (A variety of levels of learning is assessed as 
appropriate) (A=89.1%; B=71.4%; E=80.0%; P.E.=87.9%). 

FEEDBACK: 7'his assessment component also reflected characteristics noted above in 
earlier Dimension IV components. For the four assessment indicators comprising this Teaching 
and Leaming Component, moderately to significantly higher percentages of acceptable decisions 
occurred in the Art and Band subgroups over the Elective and P.E. subgroups. The Band subgroup 
obtained the highest percentages of acceptable decisions for all four indicators, while the P.E. 
subgroup received tlie lowest percentages of acceptable decisions for three out of four indicators. 

ORAL AND WRITTEN COMMUNICATION: hi the four indicators comprising this 
Teaching and Leaming Component, although all of the percentages of acceptable decisions were 
relatively high (see Table 1, Component J: 94.70% of Maximum, N=5720), tliere was some slight 
variation in percentages of acceptable decisions across the four subgroups, hi tliree of the four 
indicators the Band subgroup received slightly higher percentages of acceptable decisions than the 
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other three subgroups (indicators 2-4). While for indicator 1 (Written language used in lesson 
presentation is accurate) the Art and Elective subgroups obtained slightly higher percentages of 
acceptable decisions (A=94.1%: B=88.6%; E=93.5%; P.E.=83.3%). 

Snmrn arv Analysis For Assessment Tndicators Bv Each STAP Component "Between" CORniUyg, 
gnd Performance Groups 

Classroom and Behavior Management : Summaries of acceptable and unacceptable 
decisions for assessment indicators for Performance Dimension U, Classroom and Behavior 
Management for perfoimance and cognitive type classroom settings were compiled in table form 
(Claudet, Hill, EUett & Naik, 1990). Comparisons of the results are highUghted below. 

TIME: These eight indicators focus on the efficient aUocation and use of time for teacliing 
and learning activities. As shown in Tables 10 and 11, the percentage of acceptable decisions for 
assessment indicators in this component varied between groups. The average percentage of 
acceptable decisions was considerably greater for the cognitive classroom settings (L;M;S;SS) for 
indicators number 1 (Learning activities begin promptly) and number 5 (Minor inttnuprions are 
managed quickly and efficiently **or** there are no intermptions). The average percentage of 
acceptable decisions for the performance classroom settings (A;B;EL;PE) was greater for indicator 
number 2 (Expectations for maintaining and completing timelines for tasks are communicated to 
students). Each group consistently scored highest (Minor interruptions are managed quickly and 
efficiently **or** there are no interruptions) and lowest (Expectations for maintaining and 
completing timelines for tasks are communicated to students) on these two indicators. The overall 
percentages of acceptable decisions for Uiis component ranged from a high of 78.9% for band to a 

low of 69.8% for science. 

CLASSROOMS ROUTINES: The focus of Uiis STAR Teaching and Learning Component 
is on efficient and effective management of classroom routines necessary for enhancement of 
students' learning. The greatest percentage of acceptable decisions for assessment indicators is 
shown for indicator number 3 (Aids, materials and equipment are available and ready to use) for 
each group. Tlie percentage of acceptable decisions for this indicator ranged from a high of 90.0% 
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for the math group to a low of 83.2% for the art group. Results for indicator number 1 (The 
attention of students is ensured before directions for routines are given **or** students are 
attending) indicate the highest percentages of unacceptable decisions for each group ranging from a 
high of 50.6% unacceptable for the science group to a low of 31.4% unacceptable for the band 
group. 

STUDENT ENGAGEMENT: Decisions for Uiis STAR Teaching and Leamuig Component 
reflect the percentage of classroom settings that maintained an overall classroom engagement rate 
in learnbg tasks at or above 90%. The percentage of acceptable decisions for this assessment 
indicator was greater for the cognitive areas (L=37.3%; M=37.6%: S=34.1%; SS=40.0%) than for 
the performance areas with tlie exception of band (42.9%). where Uie greatest percentage of 

acceptable decisions was made. 

MANAGING TASK-RELATED BEHAVIOR: This Star Teacliing and Learning 
Component comprises a set of six assessment indicators Uiat focus on monitoring and managing 
students' task-related activities. As shown in tables 8 and 11. percentages for acceptable decisions 
for assessment indicators varied across groups ranging from a high of 67.1% (The teacher provides 
frequent changes in stimuli throughout the lesson to ensure leamer attention and engagement in 
learning activities) for band classes to a low of 31.5% (Active involvement is sought from students 
who arc passively involved ♦♦or** no students are only passively involved) for social science 
classes. It should be noted that science classes as well, had a low percentage (31.7%) of 
acceptable decisions for this particular assessment indicator. The science and social science class 
percentages of acceptable decisions were considerably lower than other groups for each assessment 
indicator witli Uie exception of indicator number 3 (Pays attention to/monitors momentary off-task 
behavior throughout the lesson **or** there is no momentary off-task behavior) where physical 
education classes also had a considerably low percentage of acceptable decisions (S=42.9%; 
SS=44.9%; PB=43.3%). The percentage of acceptable decisions for each assessment indicator was 
greater for band classes Uian any oUier group. The greatest difference between performance and 
cognitive type groups was noted for indicator number 1 ('Hie teacher provides frequent changes in 
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stimuli throughout the lesson to ensure learner attention and engagement in learning task(s) 
between band and social sciences (B=67.1%; SS=40.2%). Tlie percentage for unacceptable 
decisions was greater than 50% for each assessment indicator for science and social science 
settings. Physical education settings also had percentages of unacceptable decisions greater than 
50% with the exception of indicator number 1 previous mentioned. 

MONITORING AND MAINTAINING STUDENT BEHAVIOR: Tliis STAR Teacliing and 
Learning component addresses effective management of acceptable and unacceptable student 
behavior. Percentages for acceptable decisions for all groups were at or exceeded 50% for six of 
the nine assessment indicators. The percentages for these six assessment indicators ranged from a 
high of 77.1% (Uses techniques to stop unacceptable behavior ♦♦or** none are needed **or** 
there is no unacceptable behavior) for band to a low of 50% (Behavior of tlie entire class is 
effectively monitored throughout the lesson) for science. Of particular interest are tlie rather high 
percentages of unacceptable decisions for tliree of the assessment indicators for performance and 
cognitive type settings. Percentages of unacceptable decisions exceed 60% for indicators number 4 
(Students are provided (verbal and/or nonverbal) feedback about acceptable and unacceptable 
behavior) and number 5 (Feedback provided to students about their behavior is consistent with 
behavioral expectations) with the exception of band. The percentage of unacceptable decisions for 
indicator number 6 (Uses positive feedback as a means of cuing behavior expectations for students 
as needed) was at or above 60% for each subject area ranging from 60% for band to 73% for 
social sciences. The greatest range between groups was noted for indicator number 2 (Behavior of 
the entire class is effectively monitored throughout the lesson) where the difference was 17.1% 
between percentages of unacceptable decisions for band and science (B=32,9%; S=50%). 

Learning Environment : A summary table of acceptable and unacceptable decisions for 
assessment indicators from STAR Performance Dimension lU, learning Environment was analyzed. 
Comparisons were made between performance and cognitive type settings. 

PSYCHOSOCIAL: The quality of the classroom climate and positive interpersonal 
relationships between the teacher and students and among students is the focus of tliis STAR 
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Teaching and Learning Component. Assessment indicators number 1 (Establishes a classroom 
climate of courtesy and respect)(L=86.0%: M=86.2%; S=86.3%; SS=81.5%; ED=86.5%) and 
number 2 (WarmUi and friendliness are demonstrated throughout the lesson) (L^86.5%; M=87.6%; 
S=87.1%; SS=84.2%: Eb=88.2%) were noted as having Uie greatest percentages of acceptable 
decisions for the cognitive type settings and elective courses consisting of business education, 
health occupation, home economics, and trade and industrial classes. Assessment indicator number 
10 (Is fair and impartial in dealings with students) (A=85.1%: B=82.9%; PE=79.2%) was noted as 
having the greatest percentage of acceptable decisions for the performance areas of art, band, and 
physical education. Indicators number 4 (Enthusiasm for teaching, learning and Uie subject being 
taught) (L=60.9%; M=64.7%; S=66.1%: SS=69.4%; A=64.4%; B=51.4%: EL=61.8%; PE=59.2%) 
and number 10 (Tlie lesson is personalized for students) (L=59.9%; M=69.4%: 8=53.4%; 
SS=53.8%; A=64.4%; B=68.6%; EL=48.2%; PE=74.6%) present the greatest percentage of 
unacceptable decisions for each subject area wiUi the exception of social sciences and physical 
education where Uie greatest percentage of unacceptable decisions was made for indicator number 5 
(Comments, quesUons, examples, demonstrations and'or other contributions are sought from 
students throughout the lesson) (SS=56.3%: PE=67.5%). This indicator also presents Uie greatest 
difference in unacceptable decisions between groups wiUi an approximate 30% difference between 
language and physical education (L=41.6%; PE=67.5%). 

PHYSICAL: The focus of Uie four assessment indicators comprising tliis STAR Teaching 
and Leamuig Component is on Uie elements of a physical learning environment tJiat enhances Uie 
learning of aU students. Hie percentage of acceptable decisions for each assessment indicator was 
at or exceeded 70% wiUi Uie exception of indicator number 2 (Display(s) create a pleasant 
atmosphere and serve a Uiematic/content-related purpose) for physical education classes 
(PE=45.4%). Indicator number 1 (The classroom is neat. safe, and arranged in an orderly manner) 
presents Uie greatest percentage of acceptable decisions for Uiree of Uie cognitive areas and one in 
Uie performance area of physical education. For performance areas of art. band, and elective 
classes, Uie arrangement of funcUonal elements in Uie classroom is noted for Uie greatest percentage 
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of acceptable decisions, llie greatest difference iii percentages of unacceptable decisions between 
groups is shown in indicator number 4 (Arranges the functional elements of tlie learning 
environment to accommodate students wih special needs **or** there are no students with special 
needs) ranging from a high of 15.4% for physical education to a low of 5.6% for social sciences. 

Enhancement of Learning : A summary table of acceptable and unacceptable decisions for 
assessment indicators for STAR Dimension IV, Fnhancement of Learning was analyzed and 
comparisons were made between performance and cognitive type settings. Results are highlighted 
for each Teaching and Learning Component. 

LESSON AND ACTIVITIES INITIATION: For the ten assessment indicators in this 
Teaching and Learning Component, the "cognitive" and "performance" subgroups exhibited 
relatively close consistency between patterns of percentages of acceptable decisions for five of the 
indicators (1-3, 5 & 9). For the remaining five indicators tliere was wider variation obtained in the 
performance subgroup due to the significantly higher percentages occurring for the Band 
performance group. 

TEACHING METHODS AND LEARNING TASKS: Similarly, for tlie sk indicators 
comprising tliis Teaching and Learning Component, although there was a discernible pattern of 
consistency between the cognitive and performance groups in overall percentages obtained, the 
performance subgroup received moderately to significantly higher percentages of acceptable 
decisions in the Band performance subgroup for indicators 3-5. Additionally, slightly wider 
variations in the percentages of acceptable decisions occurring within the four performance subject 
area subgroupings were noted, as compared with tlie cognitive group. 

AIDS AND MATERIALS: For tlie most part, there was fairly close consistency apparent 
between the cognitive and performance groups in comparisons of percentages of acceptable 
decisions obtained williin and across the four subject areas contained in each group. Botli groups 
experienced lower percentages of acceptable decisions across the subject areas for indicators 4 and 
8 (aids and materials "broaden and enliance leiu-ning"). Comparatively, however, tlie cognitive 
group's percentages of acceptable decisions obtained for tliese two indicators were appreciably 
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lower than those obtained by tlie performance group. 

CONTENT ACCURACY AND EMPHASIS: Iii this Teaching and Learning Component, 
the relatively close pattern of internal consistency among the percentages of acceptable decisions 
obtained for the four cognitive subject areas group contrasts with tlie performance group, in which 
wider "within" variation occurred. In Uie cognitive group the widest variation among the subject 
areas was 8.2 percentage points, whereas in Uie perfomiance group, percentage variaUons among 
acceptable decisions varied by as much as 34.5 percentage points. The most significant differences 
between the cognitive and performance groups were evident in terms of extent of "wiUiin" variation 

occurred for indicators 1. & 5-7). 

THINKING SKILLS: For the eleven assessment indicators comprising tiiis Teaching and 
Learning Component. Uiere was moderate to close consistency exhibited between the cognitive and 
performance groups in degree of "within" variation in percentages of acceptable decisions among 
subject areas. OvcraU. however, the cognitive subject areas group obtained slightly higher 
percentages of acceptable decisions for the majority of indicators. Of particular interest were 
dcviaUons in this general tendency on two particular indicators where the subject areas wiUiin the 
performance group obtained significantly higher percentages of acceptable decisions in proportion 
to the cognitive group: indicator 5 (Encourages students to use mental imagery (Art), and indicator 
10 (Encourages creative thinking) (Art & Band). 

CLARIFICATION: In this Teaching and Learning Component. Uiere was relatively close 
consistency between the cognitive and performance groups across the five indicators. Overall, the 
individual percentages of acceptable decisions for subject areas contained in the perf-ormance group 
were slightly higher tlian those for the cognitive group. 

PACE: In the three assessment indicators comprising tliis Teaching and Learning 
Component the distribution of percentages of acceptable decisions raUier closely paralleled each 
other in the cognitive and performance groups. A notable exception was Uie appreciably higher 
percentages obtained by Uie Band subgroup for indicators 1 and 2 (roughly 15 to 20 percentages 
higher tlian Uie percentages for Uie oUier subject areas). 
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MONITORING LEARNING TASKS AND INFORMAL ASSESSMENT: In this Teaching 
and Learning Component, a similar pattern is evident in comparisons of the cognitive and 
performance groups as noted above in previous Dimension IV components. Although there is 
moderate consistency between the two groups in tenns of "within" distribution ranges of acceptable 
decision percentages, there are some notable exceptions in this pattern in the significantly higher 
percentages of acceptable decisions obtained in Uie Band performance subgroup, as well as the 
proportionately much higher percentages of unacceptable decisions occurring in the Art and P.E. 
performance subgroups (in comparison with otiier subject areas in both tlie cognitive and 
performance groups) for indicator 4 (SoUcits a range of responses from students for informal 
assessment purposes) and indicator 5 (A variety of levels of learning is assessed as appropriate). 

FEEDBACK: For the four assessment indicators comprising this Teaching and Learning 
Component, overall the pattern of percentages of acceptable decisions obtained for tlie subject areas 
in the performance group were moderately to significantly higher tlian those obtained for the 
subject areas represented in the cognitive group. Of particular note is indicator 2 (SuggesUons for 
improving performance are provided to students ♦♦or** none are needed) for which all of the foar 
subject areas in tlie performance group received significantly higher percentages of acceptable 
decisions than the subject areas in the cognitive group. 

ORAL AND WRIITEN COMMUNICATION: Across tlie four indicators in this Teaching 
and Learning Component, there were no appreciable variations in tlie pattern of acceptable 
decisions "within" tlie groups by subject area. There is close consistency apparent in the 
distribution of percentages obtained for tlie various subject areas in both the cognitive and 
performance groups. 
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S„mrr- rnn,n.ri.on. Beiwe-n 1<»8Q (First Fil"l Y.ar) nnd 1989-90i^ eMLEilaLJfeaiLSm 

Tiiij^chin p an(1 Teaming Component s 

The 1990 results of the percentage of maximum possible scores for each STAR Teacliiiig 
and Learning Component provide some mteresting findings in comparison to 1989 assessment 

decisions (see Table 5). 

CLASSROOM AND BEHAVIOR MANAGEMENT: In Performance Dimension H 
(Classroom Behavior and Management) the STAR Teaching and Learning Component Classroom 
Routines was found to have Uie highest percentage of maximum possible scores for boUi pUot 
years. Tlie pUot results for both years also indicate Uiat teachers in Uie same component (U.C - 
Student Engagement) received the lowest percentages of the maximum possible score (of the 
components in Uiis Dimension). A difference was noted in tlie components of Student 
Engagement. Managing Task-Related Behavior, and Monitoring and Mamtaining Student Behavior 
where Uie percentage of maximum possible scores decreased somewhat for the total sample (n) in 
the 1989-90 pUot year. The average difference for Uiese tliree components was approximately 
12%. 

LEARNING ENVIRONMENT: Tlie results for Uie Physical Learning Environment 
(1989=88.69%: 1989-90=88.03%) are most similar and show a higher acceptabUity of indicators in 
both pUot years tlian the Psychosocial Learning Environment (1989=72.73%; 1989-90=66.40%). 

ENHANCEMENT OF LEARNING: Tlie Dimension IV Component percentage figures 
obtained for tlie second pilot year show moderate to significantly lower teacher percentages of 
maximum possible scores for the enhancement of learning components in comparison witli first 
pilot year results. PUot results continue to show tlie STAR Teaching and learning Component of 
Thinking Skills as obtaining the lowest percent of the possible number of acceptable indicators and 
Oral and Written Communication as obtaining the greatest percentage of possible indicators. The 
most significant variations (decrease in percentages in second year) in teacher percentages of 
maximum possible scores across pilot years were obtained in four critical components areas: 
Lesson and Activities hiitiation (1989=50.23%; 1989-90=34.45% - 15.78% decrease); Tliinking 
Skills (1989=38.83%; 1989-90=21.56% — 17.27% decrease); Monitoring Learning Tasks and 



50 



48 

Informal Assessment (1989=54.09%; 1989-90=43.15% 10.94% decrease); and Feedback 
(1989=53.02%; 1989-90=33.22% — 19.8% decrease). 

Discussion, Implications and Conclusions 
The results of tlie series of analyses reported in this study provide some interesting findings 
relative to assessments of a large-scale sampling (n=5720) of Louisiana teachers. This cross- 
section of Louisiana classrooms encompasses a variety of subject areas and multiple 
teaching/learning contexts. As these assessments were completed during STAR second pilot year 
efforts (1989-90), tlie expanded database of classroom assessments obtained provided an 
opportunity to make comparisons of teacher classroom performance botli within this second pilot 
year sample on a variety of variables (e.g., elementary vs. secondary classrooms, beginning vs. 
experienced teachers, subject area/content, etc.), and also across first and second pilot year sets of 
teacher assessments. An important consideration in reviewing and comparing the results of data 
obtained from the first and second pilot years is the fact Uiat, during the first pUot year (Spring, 
1989), teachere taking part in field assessments had, for the most part, no orientation or prior 
knowledge of the STAR assessment components or indicators. As assessor certification sessions 
continued into the second pilot year, however, a growing number of Louisiana principals and 
master teachers, through STAR assessor certification training, were becoming knowledgeable in the 
STAR process. Tlius, these educators upon returning to their schools became valuable resource 
persons to disseminate knowledge about the content of tlie STAR teaching/learning conceptual 
framework and the observation/assessment process. As a result of tliis increased availability of 
resource information, it is interesting to examine the effects, if any, that tliis might have on teacher 
assessments obtained during the second pilot year as opposed to the first. 

As indicated in tlie results section of tliis study, teachers in second pilot year assessments 
witli the STAR received slightly to moderately lower percentages of maximum possible scores on 
components in STAR Dimensions U. Dimension III comparisons demonstrated tlie most stability 
across pilot year assessments, llie most significant variations in teacher performance percentages 
across pUot year assessments occurred in STAR Dimension IV. Tliis is particularly noteworthy 
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given the fact Uiat Dimension IV (Enhancement of Learning) emphasizes critical teacher 
performance areas related to the effectiveness of teachers' implementation of classroom methods 
and content structure, as weU as the overall enliancement of students' tliinking and leaming. 
Variations in percentage scores in four "key" Dimension IV component areas, deemed especially 
important, serve to highlight the differences. Tlrese four key teaching and learning components 
include: Lesson and Activities Initiation (an important element for motivating students and for 
providing "structure" to leaming tasks); 2) Thinking Skills (the acUve involvement of students in 
higher order thinking skill development); 3) Monitoring Leaming Tasks and Informal Assessment 
(the purposeful and continuous monitoring by teachers of tlie degree of student comprehension and 
leaming); and 4) Feedback (providing students witli feedback about both adequate and inadequate 
performances). Percentages of maximum possible scores obtained for these components during the 
second pUot assessments were aU sipnificantlv lower tlian for first pUot year, lliese percentage 
decreases were as foUows: IV.A. Lesson and Activities Initiation -- 15.78% decrease; IV.E. 
Thinking SkiUs -- 17.27% decrease; IV.H. Monitoring Learning Tasks and Infomial Assessment - 
10.94% decrease; and IV.I. Feedback 19.8% decrease. These percentage decreases may be 
attributable to continued refinements in the quality of STAR assessor certification traming during 
the second pUot year, resulting in a more comprehensive grasp of Uie STAR process and 
assessment indicators. Tlius, second year STAR assessors may have been somewhat more stringent 
and discriminating iji their professional judgments wiUi Uie STAR concerning "acceptable" versus 
"unacceptable" assessment decisions. Tliis seems particularly the case wiUi Uie Thinking Skills 
Component. 

As already described above, second pilot year assessment data results indicate considerable 
reacher variability across STAR Perfonnance Dimensions - particularly when compared wiUi data 
from the first pilot year. Assessment data from both first and second pilot year classrooms indicate 
consistent "high performance" on the STAR components of: Physical Learning Environment (UI.B) 
and Oral and Written Communication (IV.J). Results from both pUot years yielded "percentage of 
maximum possible" scores on Uiese two components that were considerably higher than tire 
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percentages obtained for other STAR components. Tliese iesults, when compared to much smaller 
percentages for oUier components, suggest that performance standards set relative to various 
components may need to be set at different levels (Ellett, 1990b). 

Results from this study demonstrate Uiat Uie most pronounced variability on performance 
percentages "wiUiin" dimensions occurred in Dimension IV. Significant differences were obtained 
by teachers during boUi pilot year assessments on percentages of maximum acceptable scores 
received on relatively "high ceiling" comi/onents (e.g., Oral and Written Communication) as 
compared with more critical "key" STAR components (e.g.. Lesson and Activities Initiation, 
Thinking SkUls, Monitoring Learning Tasks and Informal Assessment, and Feedback). It seems 
clear from the second pUot year assessment data Uiat Louisiana teachers are performing very weU 
in some STAR component areas while demonstrating substantially lower performances in other, and 
perhaps more "critical", areas (e.g., enhancement of student learning). One important implication 
suggested by Uiese findings is the desirability of continuing efforts to prepare teachers for STAR 
assessments and to utilize staff development activities for improving teaching and learning. 
Particular staff development and improvement targets include: 1) actively engaging students in 
learning; 2) monitoring of students' understandings; 3) providing purposeful feedback; and, 4) 
soliciting students* involvement in higher order tliinking. 

Tlie teacher performance variability just described extends as well to the results of tlie 
series of comparative analyses of teachers "across" various dataset subgroups. Results from the 
elementary/secondary teacher comparisons indicate that elementary teachers obtained slightly to 
moderately higher percentages of acceptable decisions on various components within the STAR 
than secondary teachers. This was particularly the case for Dimensions II and IV. Secondary 
teachers, relative to elementary teachers, scored lower in: 1) managing classroom time effectively 
(U.A) - including efficient lesson initiation and closure; 2) monitoring student task-related behavior 
(U.D) and demeanor (lI.E); 3) maintaining content-related displays (lU.B); 4) using appropriate aids 
in a timely vay (IV.C); and, 5) monitoring students' comprehension and enhancement of learning 
(IV.H). On tlie otlier hand, secondary teachers were found to obtain moderately higher percentages 
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of acceptable decisions over elementary teachers in actively involving students in some important 
thinking skills areas, such as: die development of concepts (IV.E.2) and incorporating wait time 
(IV.E.7) into activities. Considered collectively, Uiese results suggest that elementary teachers place 
somewhat more emphasis on diose aspects of classroom effectiveness associated with tangible 
preparation concerns (e.g., teacher aids, content-related displays, etc.) and are involved in more 
active student monitoring (particularly in Dmicnsion U areas) -- more "teacher-directed" concerns; 
whereas secondary teachers emphasize to a lesser extent Uiese types of teacher "structuring" 
techniques, placing greater emphasis on encouraging "teacher-assisted" direct student iiiv9lvement 
in lessons. 

Not surprisingly, findings wiien comparing beginning and experienced teacher subgroups 
tended to corroborate Uie old adage "expertise comes widi experience". Acceptable decision 
percentages across components for the experienced teacher subgroup were slightly to moderately 
higher than those for beginning teachers particularly in some important classroom management 
areas (U.A.3 - managing unnecessary delays; U.B - providing supplemental activities when needed), 
as well as 'student monitoring' components, boUi in Dimension U (U.B - ensuring students* 
attention for classroom routines, H.D - Managing Task-Related Behavior, U.E - Monitoring and 
Maintaining Student Behavior) and Dimension IV (Monitoring Learning Activities and Informal 
Assessment). It is interesting to note Uiat these component areas in which beginning teachers 
tended to fair less favorably tlian experienced teachers represent teaching tecliniques and abilities 
which teachers seem to "refine" tluough experience. 

In the comparative analysis of teacher performances on the STAR in cognitive-oriented 
versus performance-oriented classrooms, cognitive and performance subgroups tended to perform 
somewhat differentiaUy on individual component and dimensions areas, witli some variability 
within groups by specific subject area. Overall comparison patterns suggest that, aldiough tlie 
cognitive subgroup performed slightly higher tlun tlie performance subgroup on the majority of 
STAR component areas, there were some notable exceptions. The individual performance 
subgroups of Band, and to a lesser extent the Art and Electives subgroups, received significantly 
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higher percentages of acceptable decisions than tlie other subject area subgroups (including the 
cognitive subgroups) in tlie individual STAR component areas of: IV.E: Thinking Skills 
(particularly, in the areas assessing students' use of mental imagery and creative thinking); IV.H - 
Monitoring and Informal Assessment; and IV.G - Pace. A possible explanation for this finding 
may lie in the nature of these types of "performance-oriented" subject areas. Teachers may be 
more consciously aware of the importance and effects of monitoring strategies on student 
engagement in learning tasks and active involvement in "thinking" during tliese kinds of subject 
area lessons. The "high-involvement" atmosphere characteristic of performance-oriented classrooms 
such as Band and Art reflect a focused interest on the pi'it of teachers in these areas on cultivating 
and encouraging continuous active and high quality involvement from students. The extent to 
which teachers in these subject areas are overtly concerned with initiating and maintaining high 
student motivation by means of challenging performance tasks, coupled with high concern for 
active teaclier .nonitoring of student involvement levels, are important teaching strategies that 
clearly impact on tlie enhancement of student learning. One implication of these results may be 
that comparisons of different teaching methods and su-ategies employed by teachers in different 
disciplines/subject areas may inform teachers about and increase their "repertoire" of effective 
methods for motivating and involving students in learning within tlieir own content area. 

The consistently higher percentage levels obtained by teachers on typically "high ceiling" 
components, such as Physical Learning Environment (III.A) and Oral and Written Communication 
(IV. J), may suggest that perfonnance standards tor tliese components should be higher than those 
for other components. For example, in tlie four "key" component areas in Dimension IV discussed 
above, it is clear that performance standards for these components should entail realistic 
expectations that reflect tlie results of "baseline" teacher perfonnance data obtainv-J during tlie first 
and second pilot years. 

Pilot datasets of "baseline" tear^her assessments have already been utili7,ed in the setting of 
preliminary performance standards for tlie STAR components (EUctt, 1990b). These initial 
standards arc reflective of tlie variability in teacher performances across STAR component areas 
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based on samplings of teachers' "everyday practice" in classrooms under "normal" conditions. It 
becomes even more imperative that furtlier letlnement of tlie STAR Component performance 
standards be undertaken during Uic first year of statewide STAR implementation (1990-91), when 
data are obtained from assessments of teachers' performances under "high stakes" conditions. As 
the STAR is designed to observe and assess teachers at tlieir best, and if teachers - as predicted - 
do perform somewhat better (data negatively skewed) on various STAR Teacliing and Uaming 
Components under Uiese "higher stakes" conditions, performance standards will need to be adjusted 
accordingly (Ellett, 1990b). Even under "high stakes" conditions, however, it is anticipated Uiat 
there will be substantial variability in perfomiance percentages among teachers, particularly in Uiose 
STAR Teaching and Learning Components (Dimension IV) Uiat die pilot "baseline" assessments 
indicate most clearly differentiate teachers according to quality of perfomiance. 

Finally, the summary analysis of statewide data presented above has important impUcations 
for professional staff development. An informed knowledge of strengths and weaknesses of 
classroom teaching and learning as found in Louisiana's classrooms can serve as an important 
reference point for future teacher inservicing efforts and benefit die continued professional 
development and growth of all teachers. Additionally, alUiough Uiis discussion lias focused on die 
variabilities within and between content areas and educational levels in the data, it is important to 
keep in mind that with die STAR system, since the final assessment decision rests with a teacher's 
"overall" assessment score, some variability in classroom performance is possible. 
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TABLE 1 , , . 

Percentage of Maximum Possible for Teadiing and Lcanung 
Components for Each Dimension of Die STAE. 
(Lidicalors = 108) 
• . (N = 5720) 



EACUING AND LEARNING COMPONENTS 



ERFORMANCE IJIMENSION II: 

XASSROOM AND BEHAVIOR MANAGEMLNI 

i. Time 

\, Classroom Routines 
Student Engagement 
). Managing Task-Related Deliavior 
i. Moiiiloring and Maintaining Student Bcliavior 



*t of 
Inulcators 



8 
4 
1 
6 
9 



Maximum 
Possible 



43,784 
21.892 
5,473 
32,838 
49,257 



% of 

Maximum 



72.39 
74.17 
36.87 
48.48 
54.21 



>ERFORMANCE DIMENSION lU: 
.EARNING ENVIRONMENT 

\. Psycliosocial 

3. Physical 

PERFORMANCE DIMENSION IV: 
ENHANCEMENT OF LEARNING 



D. 

c. 

D. 
E. 
F. 
G. 
H. 

I. 
J. 



Lesson and Activities Initiation 

Tcacliing Metliods and Lcamiiig Task5 

Aids and Materials 

Content Accuracy and Empliasis 

Tliinlting Skills 

Clarification 

Pace 

Monitoring Learning Tasks and 
Informal Assessment 

Feedback 

Oral and Written Conununicalion 



12 
4 



10 
6 
8 
7 
11 
5 
3 

6 
4 
4 



65,676 
21,892 



66.40 
88.03 



54,730 


34.45 


32.838 


58.64 


43,784 


' 61.78 


38,311 


49.14 


60;Z03 


21.56 


27,365 


54.28 


16,419 


58.02 


32,838 


43.15 


21,892 


33.22 


21,892 


94.70 
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(N = 5720; Elcm = 2726; Sec = 2994) 

Performance Dimension U 
Classroom and Beliavior Management 



rEACHlNG AND LEARNING COMPONENTS 
TIME 

. Learning activities begin promptly. 

Expectations for maintaining and 
compleUng timelines for tasks are 
comntiunicated to students. 

Tlicrc are no unnecessary delays during Uie 
lesson. 

Tliere are no undesirable digressions. 

Minor interruptions are managed quickly 
and efficicnUy **or** there are no 
interruptions. 

Learning activities reasonably match the 
lime allocated for learning. 

Supplemental acUviUes are provided as 
needed to HU the lime allocated for 
learning. 

Learning activities continue until the end of 
the allocated time period. 



B. 

L 

2. 

3. 
4. 

C. 
1. 



CLASSROOM ROUTINES 

The attneUon of students is ensured before 
directions for routines are given ♦♦or 
students are attending. 

The teacher gives clear administrative 
directions for classroom routines ♦♦or^^ no 
directions are needed. 

Aids, malcriak and equipment are available 
and ready for use. 

Routine tasks are dealt with ui an efficient 
manner, 

STUDENT ENGAGEMENT 

Approximately 90% or more of the 
students are engaged in leanung Uu-oughout 
the lesson. 



N 


Percent 
Acceptable 

E 


S 


Percent 
Unacceptable 

N E 


S 


88.4 


91.0 


86.0 


11.6 


9.0 


14.0 


21.4 


19.4 


23.2 


78.6 


80.6 


76.8 


76.9 
86.4 


76.4 
88.6 


77.4 
84.3 


23.1 
13.6 


23.6 
11.4 


22.6 
15.7 


92.9 


93.7 


92.1 


7.1 


6.3 


7.8 


78.4 


79.1 


77.8 


21.6 


20.9 


22.2 


55.1 


54.4 


55.7 


44.9 


45.6 


44.3 


79.3 


82.8 


76.1' 


20.7 


17.1 


23.9 


56.9 


57.2 


56.7 


43.1 


42.8 


43.3 


69.6 


70.5 


68.8 


30.4 


29.5 


31.2 


88.1 


88.8 


87.5 


11.9 


11.2 


12.5 


81.4 


81.9 


80.9 


18.6 


18.1 


19.1 


36.7 


38.4 


35.1 


63.3 


61.6 


64.8 
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TEACHING AND LEARNING . OMPONENTS 



Percent 
Acceptable 



Percent 58 
Unacceptable 



MANAGING TASK-RELATED 
BEHAVIOR 

« « 

The teacher provides frequent changes in 
stimuli tluoughout the lesson to ensure 
learner attention and engagement m 
learning task(s). 

2 Active involvement is sought from students 
who arc passively involved in learning 
♦♦or** no students arc only passively 
involved. 

3 Pays attention to/monitors momeniai7 off- 
task behavior Uuoughout the lesson **or** 
there is no momentary off-task behavior. 

4 Verbal and/or non-verbal techniques are 
used to redirect students who are 

• pcrsistcnUy off-ta.sk **or** there is no 
persistent off-task behavior. 

5 Uses techniques for maintaining Uie 
engagement of students who have been 
redirected **or** tliere is no persistent off- 
task behavior. 

6 Efforts to redirect students who are 
pcrsistcnUy off-task are successful *^or** 
tliere is no persistent off-task beliavior. 

E MONITORING AND MAINTAINING 
STUDENT BEHAVIOR 

1 Expectations about acceptable student 
behavior arc made clear and aie 
consislcnUy maintained throughout the 
lesson **or** student behavior indicates 
tliat expectations arc clear and consistent. 

2. Behavior of Uie entire class is effectively 
monitored throughout tlie lesson. 

3 Uses appropriate methods to prevenl/diffusc 
situations in wliich unacceptable behavior 
may occur **or** Uiere is no unacceptable 
behavior. 

4 Students are provided (verbal and/or non- 
verbal) feedback about acceptable and 
unacceptable bcha^'ior. 

5 Feedback provided to students about their 
behavior is consistent with beliavioral 
expectations. 



N 



E 



N 



E 



50.2 



43,8 



52.8 



53.7 



47.1 



43.3 



52.6 



46.1 



55.4 



56.4 



48.8 



44.6 



48.0 



41.6 



50.5 



51.3 



45.5 



42.2 



63.4 64.7 62.2 



49.8 



56.2 



47.2 



46.3 



52.9 



56.7 



47.4 



53.9 



44.6 



43.6 



51.2 



55.4 



64.5 65.3 63.7 



35.0 36.7 33.4 



36.9 38.2 35.8 



52.0 



58.4 



49.5 



48.7 



54.5 



57.8 



36.6 35.3 37.8 



57.6 60.3 55.2 42.4 39.7 44.8 

I 



35.5 34.7 36.3 



65.0 63.3 66.6 



63.1 61,8 64.2 
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TEACHING AND LEARNING COMPONENT 

Acccptoble Unacceptable 

N E S N E S 

6 Uses positive feedback as a means of cuing 

behavior expectations for students as 33 ^ 549 63.4 66.3 

needed. 

7 Uses techniques to slop u'^cePjablc 

behavior ♦*or** none arc needed **or** ^ ^ 0 33.4 31.7 35.0 

there is no unacceptable bcliavior. 

8 Unacceptable behavior is dealt with quickly ^^.8 35.8 34.3 37.2 
♦♦or** 'ilicrc is no unacceptable behavior. 

0 Unacceptable beliavior is dealt with in a 

reasonable manner; **or** Uiere is no 353 33.8 36.6 

unacceptable bcliavior. 



Percent 



62 
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TABLE 3 ^ . 

Summary of Percentage of Acccplable and Unacceptable Scores for 
STsTAR InSwtor for Each STAR Teaching/Leanung Component 



Performance Dimension III 
Learning Environment 



TEACHING AND LEARNING COMPONENTS 



PSYCHOSOCLVL LEARNING 
ENVIRONMENT 

Establishes a classroom climate of courtesy 
and respect. 

Warmtli and friendliness are demonstrated 
throughout the lesson. 

Comments to or about students arc free of 
sarcasm, ridicule, and derogatory, 
demeaning or humiliating references. 

Enthusiasm for leaching/ learning and tlie 
subject being taught is communicated to 
students. 

Comments, questions, examples, 
demonstrations and/or other contribuuons 
arc sought from students throughout the 
lesson. 

Considers, recognizes and/or comments on 
students' contributions. 

Teachers' responses arc sufficient to 
address students' questions and comments. 

Manages incorrect resp<)nscs in a way that 
maintains students' dignity ♦*or** there 
were no incorrect responses. 

9 Shows patience, empathy or understanding 
for students who respond poorly or who 
have difficulty **or** no students liave 
difficulty. 

10. The lesson is personalized for students. 

11. Is fair and impartial in dealings with 
students. 

12. Students are given reasons for actions, 
decisions or directives made by Uie teacher 
as needed. 



N 

85.0 
86.6 

77.6 

37.8 

53.0 
64.2 
64.5 

77.8 

74.1 

39.0 



Percent 
Acceptable 

E 



85.7 
86.4 



56.7 
68.0 
64.7 



73.4 
38.9 



84.4 
86.8 



78.1 77.2 



38.4 37.3 



49.5 
60.6 
64.2 



77.0 78.4 



74.8 
39.0 



Percent 
Uiiacccptable 



N 

15.0 
13.4 

' 22.4 

62.2 

47.0 
35.8 
35.5 



14.3 15.6 

13.6 13.2 

21.9 22.8 

61.6 62.7 

43.3 50.5 

32.0 39.4 

35.3 35.8 



22.2 23.0 21.6 

25.9 26.6 25.2 
61.0 61.1 61.0 



79.2 78.8 79.6 20.8 21.2 20.4 



58.1 



57.2 



58.9 



41.9 



42.8 41.1 
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'BACHING AND LEARNING COMPONENTS 



1. 



2. 



3. 



4. 



PHYSICAL LEARNING 
ENVIRONMENT 

The classroom is ncal, safe aiid aiiangcd in • 
an orderly manner. 

Display(s) crcaic a pleasant alniosplicrc and 
serve a ihcmaUc/conieni-rclalcd puiposc. 

The functional elements of the learning 
cnviromncnt are arranged to effccuvely 
implement learning activiaes. 

Anangcs Uic funcUonal elements of Uic 
Eiming environment to acconrunodalc 
sluES with special needs ♦♦or** there 
arc no students wilii special needs. 



N 



Percent 
Acceptable 



94.2 94.8 93.7 
76.6 80.6 73.0 



89.6 89.1 90.2 



916 90.7 92.5 



Percent 
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Unacceptable 
N E S 



5.8 



8.4 



5.2 



9.3 



6.3 



23.4 19.4 27.0 



10.4 10.9 9.8 



7.5 
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TABLE 4 

Summary of Percentage of Acceptable and Unacceptable Scores for 
Each STAR Indicator for Each STAR TcachingAxammg Component 
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Perfonnance Dimension IV 
Enlianccment of Learning 



TEACHING AND LEARNING COMPONENTS 



LESSON AND ACTIVITIES 
INITIATION 

Student attention is ensured before 
directions and explanations for learning 
activities are provided **or** students are 
attending. 

Activities are initiated witli motivating 
introductions wliich are content related. 

Clearly commiuiicatcs specific learning 
outcomes to students. 

The purpose and importance of learning 
activities are communicated to students. 

Procedural directions necessary to 
implemenl learning tasks are clear and 
complete. 

6. Expectations about student engagement in 
learning tasks arc communicated at the 
beginning of activities. 

7. Clearly communicates tJie challenge of 
learning lask(s) to students as needed. 

8. Encourages all students to participate. 

9. Reviews past learning to ensure students' 
readiness for new learning as needed. 

10. As new ideas/concepls/aclivities are 
introduced, they are related to past and 
future learning. 



Percent 
Acceptable 



N 



53.5 
25.6 
28.1 
18.6 



13.9 
51.9 

44.4 
21.3 



54.8 
28.5 
28.9 
16.9 



26.1 26.2 



13.6 
55.1 



52.3 
22.9 
27.3 
20.2 



61.1 62.9 59.5 



26.0 

14.1 
49.0 



47.1 41.9 



19.5 23.0 



Percent 
Unacceptable 



N 



46.5 
74.4 
71.9 
81.4 

38.9 

73.9 

86.1 
48.1 

55.6 
78.7 



45.2 
71.5 
7i.l 
83.1 

37.1 



86.4 
44.9 



47.7 
77.1 
72.7 
79.8 

40.5 



73.8 74.0 



85.9 
51.0 



52.9 58.1 



80.5 77.0 



B. TEACHING METHODS AND 
LEARNING TASKS 

1. Use of methods is appropriate for tJie 
complexity ol lesson content. 

2. Tcacliing methods and learning tasks or 
topics within an activity are sequenced in a 
logical order. 



74.3 76.1 72.8 



87.1 88.8 85.5 



25.7 23.9 27.2 



12.9 11.2 14.5 
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TEACHING .\ND LEARNING COMPONENTS 



Percent 
Acceptable 



Percent 
Unacceptable 



63 







N 


E 


S 


N 


E 


c 
o 


3. 


Uses two or more mclhoas Lhal enliance 
student interest and actively involve 
students in learning tasks. • • 


55.1 


58.1 


52.4 


44.9 


41.9 


47.6 


4. 


The teacher and the students interact in 
more than one group size. 


59.8 


63.0 


57.0 


40.2 


37.0 


43.0 


5. 


Mclliods and h^iming tasks used enhance 
mastery of learning objectives. 


50.2 


52.9 


47.8 


49.8 


47.1 


52.2 


6. 


Provision is made for Icssoiiyacliviues 
closure. 


25.2 


26.6 


24.0 


74.8 


73.4 


76.0 


C. 


AIDS AND MATERIALS 














1. 


The use of teaching aids is appropriate for 
methods and objectives. 


72.5 


74.9 


70.3 


27.5 


25.1 


zy. / 


2. 


Teaching aids are used properly and 
accommodate the range of student needs 
and abilities. 


62.8 


64.2 


61.5 


37.2 


35.8 


38.5 


3. 


Teaching aids are used at appropriate times 
in the lesson. 


72.5 


75.0 


70.2 


27.5 


25.0 


29.8 


4. 


The use of teaching aids broadens 
understandings and enliances learmng. 


50.3 


51.6 


49.2 


49.7 


48.4 


5U.O 


5. 


The use of learning materials is appropriate 
for learning tasks and objectives. 


70.1 


73.0 


67.5 


29.9 


27.0 




6. 


Learning materials are used properly and 
accommodate die range of needs ana 
abilities of students. 


47.8 


46.8 


48.6 


52.2 


53.2 


51.4 


7. 


Learning materials are used at appropriate 
times in the lesson. 


70.2 


73.1 


67.6 


29.8 


26.9 


32.4 


8. 


Use of learning materials broadens student 
understandings and enliances learning. 


48.1 


49.0 


47.2 


51.9 


51.0 


52.8 



o 
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TEACHING AND LEARNING COMPONENT? 



Percent 
Acceptable 



Percent 
Unacceptable 
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N 


E 


S 


N 


B 


S 


D. 


CONTENT ACCURACY AND 
EMPHAblo 














I. 


Students arc given opportunities to learn at . 
r^t^rn than one coRnitive ana/or 
pcrfonnance level. 


32.0 


32.1 




68.0 


67.9 


68.0 


2. 


Emphasizes the value and importance of 
fnnir^ and activities. 


19.2 


16.9 


21.3 


80.8 


83.1 


78.7 


3. 


Content knowledge is accurate and up-to- 


93.5 


94.4 


92.6 


6.5 


5.6 • 


7.4 


4. 


dale. 

Content knowledge is logical. 


87.2 


88.3 


86.1 


12.8 


11.7 


13.9 


5. 


»• ^ ««/4 <»vni'imfinn9 related to 
Du'ections and cxpianauun^ luuii^^u 

lesson content and/or Icammg tasks are 


57.1 


57.6 


56.7 


42.9 


. 42.41 


43.3 


6. 


Essential elements of content knowledge 
and/or performance tasks arc emphasized. 


28.7 


27.3 


30.0 


71.3 


72.7 


70.0 


7. 


Pr,i/.ntinl areas or Doints of difHculiy are 
emphasized throughout llie lesson. 


26.2 


26.4 


1 


73.8 


73.6 


73.9 


E. 


THINKING SKILLS 














1. 
2. 


AssociaUons are taught and used in 
learning. 

Involves students in developing concepts. 


26.3 
26.1 


25.7 
29.3 


26.8 
23.2 


73.7 
73.9 


74.3 
70.7 


73.2 
76.8 


3. 


Involves students in developing principles 
and/or rules. 


15.3 


15.4 


15.1 ' 


84.7 


84.6 


84.9 


4. 

5. 
6. 


Encourages students to think of and recall 
examples ."rom their own experiences. 

Encourages students lo use menial imagery. 
Asks a variety of questions. 


22.7 
29.3 


23.4 
14 4 

28.8 


22.1 
13.5 
29.8 


77.3 
86.1 
70.7 


76.6 
85.6 
71.2 


• 77.9 
86.5 
70.2 


7. 


Wail lime is used to enhance student 


38.2 


42.2 


34.6 


61.8 


57.8 


65.4 


8. 


Encourages criUcal analysis and/or problem 
solving. 


18.4 


18.7 


18.2 


81.6 


81.3 


81.8 


9. 
10. 


Encourages students to elaborate, extend or 
critique their own or olhcr students 
responses. 

Encourages creative thinking. 


18.5 
14.8 


19.4 
15.0 


17.6 
14.6 


81.5 
85.2 


80.6 
85.0 


82.4 
85.4 


U. 


Provides opportunities for the extension of 
leatmng to new contexts. 


13.6 


12.8 


14.3 


86.4 


87.2 


85.7 
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TEACHING AND LEAilNING COMPONENTS 



F. CLARIFICATION 

1 Areas of misunderstanding or difficulty are . 
idenUfied before students ask questions 
**or** no misunderstanding or difficulty 
occurs. 

2 Different words or cxoinpl^.s are used m 
clarincaUon ♦♦or** no clariHcaUon is 
needed. 

3 Bases for learner difficulties or 
misunderstandings are sought **or** no 
misunderstandings or difficulues occur 
**or** probing is not necessary. 

4 Clarincadons are made for individuals or 
small groups rather than for Uie entire class 
♦♦or** this type of clarification is not 
necessary. 

5 AUempts to eluninatc misunderstanding are 
successful **or** no laisunderstandmg 
occurs. 



Percent 
Acceptable 



N 



57.4 56.6 58.1 



63.7 63.6 63.9 



60.6 60.7 60.5 



Pcrccnl 
Unacceptable 



N 



44.2 45.0 43.5 55.7 55.0 56.4 



42.6 43.4 41.9 



45.3 46.2 44.5 54.7 53.8 55.5 



36.3 36.4 36.1 



39.4 39.3 39.5 



G. PACE 

1. Lcammg activities are iinplemenlcd at an 
appropriate pace. 

2 Summarizes or reviews during tlie lesson to 
monitor/assess Uic pace of leaching and 
learning. 

3. Provides sufficient time for students to 
complete learning task(s). 

H MONITORING LEARNING TASKS 
AND INFORMAL ASSESSMENT 

1. Monitors students' iniUal engagement in 
learning tasks. 

2. Monitors students' engagement during 
learning tasks. 

3. Monitors tlie completion of learning lask.s. 

4 Solicits a range of responses from students 
for informal assessment purposes. 

5. A variety of learning is assessed as 
appropriate. 



67.3 67.6 67.0 32.7 32.4 33.0 

32.5 34.5 30.6 67.5 65.5 69.4 

74.3 75.6 73.1 25.7 24.4 26.9 



56.7 

52.8 
45.0 

37.2 

19.6 



59.4 54.3 



55.1 
47.6 

19.6 

19.6 



50.8 
42.6 

34.3 

19.5 



43.3 

47.2 
55.0 

62.8 

80.4 



40.6 45.7 



44.9 
52.4 

59.6 

80.4 



49.2 
57.4 

65.7 

80.5 
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TEACHING AND LEARNING COMPONENTS 



N 



Percent 
Acceptable 



66 

Percent 
Unacceptable 



N 



6 Adjustments within the Itsson are made as 
needed **or** no adjustments are 
necessary. 



47.6 



49.0 46.2 



52.4 



51.0 53.8 



L FEEDBACK 

1. Provides specific lecdback to studenLs 
about responses which are adequate and 
inadequate. 

2 Sugg slions for improving performance are 
provit-id to students **or** none are 
ncedet 

3. Revisits students who have responded 
inadequately. 

4. Provides specific feedback lo students 
when they have mastered leambig 
obJcctive(s). 



36.3 37.0 35.7 



33.7 32.6 34.8 



36.6 38.6 34.8 



26.3 27.9 . 24.8 



63.7 63.0 64.3 



6(3.3 67.4 65.2 



63.4 61.4 65.2 



73.7 72.1 75.2 



J. ORAL AND WRITTEN 
COMMUNICATION 

1. Written language used in lesson 
presentation is accurate. 

2. Oral language used in lesson presentation 
is accurate and easy to understand. 

3. Uses appropriate vocabulary m oral and 
written language. 

4. Communication is precise with few false 
starts, interrupters or inappropriate 
qualifiers. 



95.6 96.1 95.1 



95.6 95.5 95.7 



96.2 96.2 96.1 



91.4 91.6 91.3 



4.4 



4.4 



3.8 



8.6 



4.5 



3.8 



8.4 



4.9 



4.3 



3.9 



8.7 



I 
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TABLE 5 

Comparison of Percentages of Maximum Possible for Teaching and Learning 
Components on Dimensions II. lU & IV of the STAR for 
First and Second Pilot Year Assessment Data 
(1st Yr. N=969; 2nd Yr. N=5473) 
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Isi Pilot Year 



2nd Pilot Year 



TEACfflNG AND LEARNING COMPONENTS 



ft of 
Ind. 



Max. 
Poss. 



% of 
Max. 



II of 
Ind. 



PERFORMANCE DIMENSION II: 
CLASSROOM & BEHAVIOR MANAGEMENT 

A. Time 

B. Classroom Routines 

C. Sludcul Engagement 

D. Managing Task-Related 
Behavior 

E. Monitoring and Maintaining 
Student Behavior 

PERFORMANCE DIMENSION UI: 
LEARNING ENVIRONMENT 



A. 
B. 



Psychosocial 
Physical 



PERFORMANCE DIMENSION IV: 
ENHANCEMENT OF LEARNING 



ERIC 



8 
4 
1 
7 

10 



7,752 
3.876 
969 
6,783 

9,690 



73.41 
81.84 
47.47 
62.14 

67.46 



8 
4 
1 
6 



15 
5 



14,535 72.73 
4,845 88.69 



12 
4 



Max. 
Poss. 



43,784 
21,892 
5,473 
32,838 
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% of 
Max.- 



72.39 
74.17 
36.87 
48.48 



49,257 54.21 



65,676 66.40 
21,892 88.03 



A. 


Lesson and Activities Initiation 


10 


9,690 


50.23 


10 


54,730 


34.45 


B. 


Teaching Methods and Leammg Tasks 


5 


4,845 


71.04 


6 


32,838 


58.64 


C. 


Aids and Materials 


10 


9,690 


72.06 


8 


43,784 


61.78 


D. 


Content Accuracy and Emphasis 


8 


7,752 


65.26 


7 


38,311 


49.14 


E. 


Tliinking Skills 


11 


10,659 


38.83 


11 


60,203 


21.56 


F. 


Clarification 


5 


4,845 


67.47 


5 


27,365 


54.28 


G. 


Pace 


5 


4,845 


65.59 


3 


16,419 


58.02 


H. 


Monitoring Learning Tasks and 
Informal Assessment 


6 


5,814 


54.09 


6 


32,838 


43.15 


I. 


Feedback 


4 


3,876 


53.02 


4 


/. 892 


33.22 


J. 


Oral and Written Communication 


4 


3,876 


94.66 


4 


21,892 


94.70 



APPENDIX D 

Organizational Slructure of the 1989 
System for Teaclilng and learning Assessment and Review (STAR) 

STAR Teaching and Lcarnuig Component of TIME 
witli accomiJiuiying Assessment Indicators, 
Annotations and Decision Making Rules 



71 



STAR 

System (or Jeaching and Learning Assessment and Review 
PERFORMANCE DIMENSION 1: P^I^ARATION^^^^^^^^^ 

TEACHING AND LEARNING COMPONENTS 

A. Goals and Objectives (6)b 

B. Teaching Methods and Learning Tasks (6) 

C. Allocated Time and Content Coverage (4) 

D. Aids and Materials (5) 

E. Homework (4) ^ r- i n\ 

F. Formal Assessment and Evaluation (/) 

PERFORMANCE DIMENSION .,: CU^SSROOM^AND ^ 

TEACHING AND LEARNING COMPONENTS 

A. Time (8) 

B. Classroom Routines (4) 

C. Student Engagement (1) . 

D. Managing Task-Related Behavior (6) 

E. Mcnitoring and Maintaining Student Behavior (9) 

PERFORMANCE DIMENSION III: LEARNING ENVIRONMENT (16) 
TEACHING AND LEARNING COMPONENTS 

A Psychosocial Learning Environment (12) 
e! Physical Learning Environment (4) 

PERFORMANCE DIMENSION IV: ENHANCEMENT OF LEARNING (64) 
TEACHING AND LEARNING COMPONENTS 

A. Lesson and Activities Initiation (10) 

B. Teaching Methods (6) 

C. Aids and Materials (8) , 

D. Content Accuracy and Emphasis (/) 

E. Thinking Skills (11) 

F. Clarincation (5) 

h! Monitoring Learning Tasks and Informal Assessment (6) 

I. Feedback (4) . . 

J. Oral and Written Communication (4) 



a 



Number of Assessment Indicators Comprising Performance Dimension 
b Number of Assessment Indicators Comprising Teaching and Learning Component 
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PERFORMANCE DIMENSION II: CLASSROOM AND BEHAVIOR MANAGEMENT 



Effective classroom and behavior manaaement comprise a necessary element oi enecii^e 
teachinq pertormance. Clearly communicated and well-established behavioral expectations and fair and 
consistent conseauences facflilate effective and efficient rnonitoring and rriaintenarice of accep^le 
student behavior; Students' active engagement in learning tasks, a strong _ correlate of student 
achievement is maximized through stimulus variation and redirecting and revisiting students who are 
^oS tSkT Appropriate learning Ictivities should be provided for "early f nishers" to. maximize learning 
time and student engagement in learning tasks. Time for learning is further maximized by iniUa ng 
leaching and learning activities promptly, implementing transitions without delays, efficiently handling 
routine tasks and avoiding undesirable digressions from topics or learning activities. 



TEACHING AND LEARNING COMPONENTS 



I. A. Time H.C. Student Engagement 

I.B Classroom Routines II.D. Managing Task-Related 

Behavior 

II. E, Monitoring and Maintaining 
Student Behavior 



-J 

o 



ERLC 



7J 



TEACHING AND LEARNING COMPONENT II.A: TIME 



COMMENTS: Teaching and learning activities reasonably reflect allocated time, begin promptly, 

proceed efficiently with smooth transitions and no undesirable digressions and 
allow for maximum opportunities for student engagement in learning. "Activity" 
refers to ail ttilngs teachers and students do in the classroom. 



RESEARCH BASE 



Research in classroom management suggests that effective use of time involves effective 
management of classroom activities. Brophy and Evertson (1976) found strona and consistent positive 
relationships between student engagement in tasks and learning gains. Similarly, in a study by 
Evertson, et al. (1980), positive correlations were found t>etween effective manaqement skills and 
teacher control (teacher's use of time) and student achievement. According to Scott and Bushell 
(1974), teaching and learning time is most effectively utilized when teachers spend minimal amounts of 
time helping individual students. Arlin (1979) has found tliat teacher use of structured transfttons (e.g., 
giving students procedural directions, establishing transition routines) results in a decrease in 
unnecessary delays in teaching and learning. Additionally, there are several recent studies which lend 
further support to the notion that teachers who are efficient classroom managers maximize student 
engagement time by minimizing organization and transition time during lessons (Coker, Medley and 
Soar, 1980; Fisher et al. 1980; Good and Grouws, 1979; Stallings, Cory, et al. 1977). 
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TEACHING AND LEARNING COMPONENT II.A: TIME 



ASSESSMENT INDICATORS 

II.A.1 Learning activities begin promptly 



ANNOTATION 

This indicator focuses on the beginning of 
the lesson. Learning activities should begin 
with little time spent on organizational 
jictivities such as roll taking and distributing 
materials and supplies. The efficiency with 
which organizational activities are handled is 
always a concern. 

IF A SIGNIFICANT AMOUNT OF TIME IS 
WASTED AT THE BEGINNING OF THE 
LESSON, THE INITIAL USE OF TIME IS 
UNACCEPTABLE. 



NOTES/CLARIFICATION 



.A.2 Expectations for maintaining and 
completing timelines for tasl<s are 
communicated to students. 



As initial tasks begin and as tasks change 
throughout the lesson, the teacher should 
clearly communicate to students when tasks 
are to be completed. Cautions about 
wasting time and informing students about 
the persistence needed to complete tasks 
on time are elements of effective communi- 
cation of expectations. 

IF THE TEACHER DOES NOT 
ADEQUATELY COMMUNICATE THESE 
EXPECTATIONS TO STUDENTS. THE 
USE OF TIME AVAILABLE FOR 
LEARNING IS UNACCEPTABLE. 



*0 
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